-- Logs begin at Thu 2022-02-03 02:17:15 UTC, end at Thu 2022-02-03 03:14:37 UTC. -- Feb 03 02:43:33.685670 dv-cinder-827581-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 03 02:43:33.694392 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 3 02:43:33 2022] *** Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: nodename: dv-cinder-827581-1-iscsi Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: machine: x86_64 Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: clock source: unix Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: pcre jit disabled Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: detected number of CPU cores: 4 Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: current working directory: / Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: detected binary path: /usr/bin/uwsgi-core Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: your processes number limit is 47680 Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: your memory page size is 4096 bytes Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: detected max file descriptor number: 2048 Feb 03 02:43:33.696398 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: lock engine: pthread robust mutexes Feb 03 02:43:33.697258 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: thunder lock: enabled Feb 03 02:43:33.699137 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 03 02:43:33.699137 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 03 02:43:33.742521 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: Python main interpreter initialized at 0x5627bb6dc9c0 Feb 03 02:43:33.742521 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: python threads support enabled Feb 03 02:43:33.742521 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: your server socket listen backlog is limited to 100 connections Feb 03 02:43:33.742521 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: your mercy for graceful operations on workers is 90 seconds Feb 03 02:43:33.742911 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: mapped 403077 bytes (393 KB) for 2 cores Feb 03 02:43:33.742986 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: *** Operational MODE: preforking *** Feb 03 02:43:33.743235 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: *** uWSGI is running in multiple interpreter mode *** Feb 03 02:43:33.743235 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: spawned uWSGI master process (pid: 79150) Feb 03 02:43:33.743456 dv-cinder-827581-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 03 02:43:33.744170 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: spawned uWSGI worker 1 (pid: 79163, cores: 1) Feb 03 02:43:33.744329 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: spawned uWSGI worker 2 (pid: 79164, cores: 1) Feb 03 02:43:33.744469 dv-cinder-827581-1-iscsi devstack@keystone.service[79150]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 03 02:43:39.338904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:43:39.338904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: from cryptography.utils import int_from_bytes Feb 03 02:43:39.339698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:43:39.339698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: from cryptography.utils import int_from_bytes Feb 03 02:43:39.340949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:43:39.340949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: from cryptography.utils import int_from_bytes Feb 03 02:43:39.341446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:43:39.341446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: from cryptography.utils import int_from_bytes Feb 03 02:43:39.384966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 03 02:43:39.385145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 03 02:43:39.385310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] command line args: [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 03 02:43:39.385598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 03 02:43:39.385770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ================================================================================ {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 03 02:43:39.386051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] admin_token = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.386180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 03 02:43:39.386263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 03 02:43:39.386327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] config_dir = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.386455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] command line args: [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 03 02:43:39.386545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.386611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] config_source = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.386672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 03 02:43:39.386796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] debug = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.386878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ================================================================================ {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 03 02:43:39.387009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] admin_token = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] config_dir = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] config_source = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.387813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] debug = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_config_append = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_dir = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_file = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.388956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_config_append = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_dir = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_file = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.389842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.390946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.391956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.392956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] publish_errors = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393432 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.393953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] publish_errors = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] standard_threads = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.394951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] use_journal = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] standard_threads = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] use_json = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] use_stderr = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] use_syslog = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.395928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] use_journal = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.396013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.396088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] use_json = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.396162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.396262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] use_stderr = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.396420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] use_syslog = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.396507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.396652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:43:39.396772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.396924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.397966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.398098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.398198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.398354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.398436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.398584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.399968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.400969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.401929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.402922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.403957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.404965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.405989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.406855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.407897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.408862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.409970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.410918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411031 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.411959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412694 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.412970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.413998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414540 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.414994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.415911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.416870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.417947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.external = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.418904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.password = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] auth.token = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.external = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.419942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.password = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.420828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] auth.token = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.421931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.422957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.423916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.424915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.425906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.426851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.427965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.428939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429015 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.429955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.430885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.431987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.432970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433276 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.433984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.434913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435069 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.435855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.436977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.437981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.438990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.439926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.440877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.441969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.442972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.443909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.444870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.445030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.445106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.445266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.445354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.445500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.445577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.446964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.447856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.448971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.449991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.450923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] role.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] role.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.451864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] role.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] role.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.452866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.453853 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454328 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.454984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.455947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.456891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.457860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.458962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.459964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.460945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.461883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.462992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.463936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.connection = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.464924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.connection = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.465957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.466941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.467929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.468809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 03 02:43:39.468879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.469120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.469464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.469718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.469960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:43:39.470131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 03 02:43:39.498493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.498708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.498885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.498965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.499026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.499154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.507470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.507670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.537052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.537257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.537346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.537480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.590236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.590402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.640646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.640873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.641406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.641611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.705467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.705626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.705694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.705756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.705897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.706648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.729533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.729669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.729739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.729823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.729976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.730962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.742579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.742706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.755241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.755437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.755597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.755729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.755881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.756953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 03 02:43:39.773702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.773955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 03 02:43:39.774076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.774249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.774378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 03 02:43:39.774469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 03 02:43:39.774549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.774691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.774817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 03 02:43:39.774898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.774972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.775188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.775316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.775413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.775501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.775737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.786061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.786323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.786448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.786562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.786654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.786870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.787008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.787126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.794708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.794997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.797947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.798254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.800034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.800303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.800427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.800608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.800771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.800880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.800971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801302 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.801954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.802045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.802239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.802364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.802520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.802612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.802741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.828257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.828479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.829906 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.830165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.830291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.830441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.835306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.835578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.835703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.835850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.835973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.836095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.843029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.843237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.843334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.843495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.847738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.847995 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.848144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.848261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.848353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.848560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.848701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.848830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.848909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.849911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.868273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.868399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.868543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.868668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.872981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.873123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.876502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.876628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.876841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.876970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.881631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.881778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.885235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.885363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.888709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.888891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.889822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.890033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.890163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.890310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.908653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.908945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.909200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.909327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.909441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.909623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.909703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.909991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.917086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.917613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.918729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.919001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.919258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.919528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.921955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.922232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.922529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.922655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.922827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.922953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.923068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.923207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.923362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.923638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.936121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.936397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.936627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.936800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.936893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.936968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.937190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.937319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.937436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.937527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.937736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.937862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.938009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.938300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.955200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.955736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.958358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.959057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.961674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.962310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.963205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.963840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.964812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.965089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.965383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.965509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.965701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.965988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.972505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.973153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.974095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.974696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.977236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.977526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.977804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.977930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.978078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.978204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.978406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.978681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.987394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.987687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.987954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.988079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.988307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.988587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.995582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.995862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.996146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.996271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 03 02:43:39.996395 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.996486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.996689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.996849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.996962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.997859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.998881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.999052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.999190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.999415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:39.999703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 03 02:43:40.035836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5627bb6dc9c0 pid: 79164 (default app) Feb 03 02:43:40.036290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5627bb6dc9c0 pid: 79163 (default app) Feb 03 02:43:40.040015 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66fcc-7ed5-45ff-925a-4d767c9c9ab1 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:40.040316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66fcc-7ed5-45ff-925a-4d767c9c9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:40.040593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66fcc-7ed5-45ff-925a-4d767c9c9ab1 None None] PATH_INFO: `/v3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:40.044851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 791 bytes} [Thu Feb 3 02:43:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:48.174447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c225d4-f98d-4c2a-a3ef-f424c550f5a5 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:48.174974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c225d4-f98d-4c2a-a3ef-f424c550f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:48.174974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c225d4-f98d-4c2a-a3ef-f424c550f5a5 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:48.180104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:48.185763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:48.186199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:48.186285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:48.216734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG oslo_db.sqlalchemy.engines [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:43:48.506502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG passlib.handlers.bcrypt [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79164) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 03 02:43:48.506910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG passlib.handlers.bcrypt [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79164) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 03 02:43:48.562570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:48.564245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:48.697653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:48.888517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c225d4-f98d-4c2a-a3ef-f424c550f5a5 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:48.924592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG oslo_db.sqlalchemy.engines [None req-83c225d4-f98d-4c2a-a3ef-f424c550f5a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:43:49.164778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c225d4-f98d-4c2a-a3ef-f424c550f5a5 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:49.170223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:49.170874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:49.171152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:49.171420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:49.185785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:49.237855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.common.rbac_enforcer.enforcer [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 03 02:43:49.238170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f3387-98e3-4e77-901e-e21b9dde1fa1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:49.248222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 2/4] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:43:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:43:49.257410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:49.274515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a49ae-741e-4c43-a1a7-957f5dd54541 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:49.280151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:49.281303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:49.281586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:49.281921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:49.284432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:49.335178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 03 02:43:49.335512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35254ff6-a78a-4ddc-9430-579df4687073 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:49.340123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 3/5] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:43:49 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:51.511026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b491bb6-3489-4b37-8792-bcb51d704dc1 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:51.511854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b491bb6-3489-4b37-8792-bcb51d704dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:51.511990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b491bb6-3489-4b37-8792-bcb51d704dc1 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:51.519530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 3/6] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:51.525297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:51.525704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:51.525860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:51.546977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:51.548543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:51.557892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:43:51.581270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b491bb6-3489-4b37-8792-bcb51d704dc1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:51.600894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b491bb6-3489-4b37-8792-bcb51d704dc1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:51.607083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8f488-9feb-4ea9-a337-c706c4c06d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:51.607709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8f488-9feb-4ea9-a337-c706c4c06d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:51.607988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8f488-9feb-4ea9-a337-c706c4c06d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:51.608258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8f488-9feb-4ea9-a337-c706c4c06d1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:51.617286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8f488-9feb-4ea9-a337-c706c4c06d1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:51.619069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8f488-9feb-4ea9-a337-c706c4c06d1b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:51.628302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 4/8] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:43:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:43:51.636576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:51.653310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073725d9-3108-4d70-90a2-10546e0edb4d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:51.660104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fa520-0cb0-4df4-96f8-2080c214aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:51.661003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa520-0cb0-4df4-96f8-2080c214aa5b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:51.661285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa520-0cb0-4df4-96f8-2080c214aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:51.661549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa520-0cb0-4df4-96f8-2080c214aa5b admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:51.663091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fa520-0cb0-4df4-96f8-2080c214aa5b admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:51.664980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fa520-0cb0-4df4-96f8-2080c214aa5b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:51.666555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 5/9] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:43:51 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:53.892134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d027f-8efd-469b-b1a3-bd06652f3291 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:53.892686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d027f-8efd-469b-b1a3-bd06652f3291 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:53.892686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d027f-8efd-469b-b1a3-bd06652f3291 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:53.894422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:53.900106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:53.900496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:53.900653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:53.919158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:53.920340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:53.929133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 6/11] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:53.954368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179da6-75b6-4dab-970d-849667aa1444 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:53.954666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:53.954763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179da6-75b6-4dab-970d-849667aa1444 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:53.955007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179da6-75b6-4dab-970d-849667aa1444 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:53.956673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 6/12] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:53.962335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:53.962603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:53.962891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:53.966325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b1584-98d5-45e2-a32a-980af71e23ef None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:53.971796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:53.972733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:53.973016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:53.973374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:53.991747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:43:54.000597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:43:54.001899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 7/13] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:43:54.007764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:54.010305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG passlib.handlers.bcrypt [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79163) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 03 02:43:54.010736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG passlib.handlers.bcrypt [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79163) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 03 02:43:54.018077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf6aa-e18e-4448-8f0f-cd55772d93fa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:54.024345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:54.025007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:54.025295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:54.025564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:54.026324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:43:54.026625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:54.028429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:54.028429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:43:54.028429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:43:54.029351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:54.043193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 8/14] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:54.048625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:54.056855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:54.058365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90572-33b1-49d1-a1b2-f5f3d4abc477 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:54.058593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:54.063128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:54.063939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:54.064218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:54.064487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:54.065806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:54.067614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:54.069355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 9/15] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:43:54 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:54.074210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:54.080260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 7/16] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:43:54.084212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1137a-fdec-482e-b6ac-9c9db3b9a40b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:54.088987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:54.089770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:54.090046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:54.090321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:54.091523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:54.093331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:54.095054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 10/17] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:54.100822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:54.102146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:54.112601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68009ae-de20-4f2c-bcec-e9e512be957d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:54.113516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55212413-0bef-4c8a-91c2-f19073042d81 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:54.117368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab538b1-dccc-414a-93bd-728d2440a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:54.117979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab538b1-dccc-414a-93bd-728d2440a6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:54.118251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab538b1-dccc-414a-93bd-728d2440a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:54.118535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab538b1-dccc-414a-93bd-728d2440a6ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:54.119201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:54.120165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:54.120459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:54.120747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:54.121762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.domain.id=default, user.id=fbd82c2696a04c4883c8116f54cc6d64) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:43:54.122072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:54.123841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:54.123841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:43:54.123841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:43:54.125046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:54.126341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab538b1-dccc-414a-93bd-728d2440a6ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:54.128094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab538b1-dccc-414a-93bd-728d2440a6ca admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:54.134384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 8/18] 10.222.0.31 () {56 vars in 1343 bytes} [Thu Feb 3 02:43:54 2022] GET /identity/v3/role_assignments?user.id=fbd82c2696a04c4883c8116f54cc6d64&scope.domain.id=default&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 233 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:54.136935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 11/19] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:43:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:43:54.142943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:54.153538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7accd56-27b0-479a-907f-588d2e302b6d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:54.158680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285e524-dedf-4748-9d91-c393755e195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:54.159503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e524-dedf-4748-9d91-c393755e195f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:54.159777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e524-dedf-4748-9d91-c393755e195f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:54.160036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e524-dedf-4748-9d91-c393755e195f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:54.161583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e524-dedf-4748-9d91-c393755e195f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:54.163421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e524-dedf-4748-9d91-c393755e195f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:54.165141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 9/20] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:56.716773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec2f3f-44f7-459f-b935-a22b2dba6258 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.717637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec2f3f-44f7-459f-b935-a22b2dba6258 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.718068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec2f3f-44f7-459f-b935-a22b2dba6258 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.720764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 12/21] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:56.726872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.727356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.727608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.755604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:56.756846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:56.768735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 10/22] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:56.809034 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec2f3f-44f7-459f-b935-a22b2dba6258 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:56.827226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec2f3f-44f7-459f-b935-a22b2dba6258 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:56.832808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:56.833618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.833900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.834173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.851853 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:56.853859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:56.873715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-7b93795b-a807-4245-abea-1c1da3fac56d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:43:56.875103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 13/23] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:43:56.881320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:56.888779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f082bb-57e5-4acd-82b4-7bf2c3540c18 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.889076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f082bb-57e5-4acd-82b4-7bf2c3540c18 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.889357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f082bb-57e5-4acd-82b4-7bf2c3540c18 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.891340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 14/24] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:56.893307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd8492-1a77-420e-9750-e22c029e5d23 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:56.896288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.896582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.896887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.903466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:56.904148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.904422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.904693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.905463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:43:56.905766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:56.906862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:56.906862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:43:56.906862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:43:56.907771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:56.921780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:56.923051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:56.938176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 11/25] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:56.940363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 15/26] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:43:56.944436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:56.958314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ed5a4-d543-484a-bd37-ddcca55c1bda admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:56.968080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:56.968674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.968973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.969312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.970039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:56.971054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:56.971054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:43:56.971054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:43:56.972257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028021-5c4a-4f55-9b43-464a84e09278 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:56.973738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:56.987441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87b18-db50-4f00-9291-7439230c36c0 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:56.996757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:56.997446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:56.997729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:56.998005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:56.998779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:56.999820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:56.999820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:43:56.999820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:43:57.000804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:57.158370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 12/27] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:43:56 2022] POST /identity/v3/projects => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:43:57.161117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b577-7980-4494-bb1e-66027e53a09b None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.161408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b577-7980-4494-bb1e-66027e53a09b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.161685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b577-7980-4494-bb1e-66027e53a09b None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.167387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 13/28] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:57.170415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.170705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.170992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.191025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 16/29] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:43:56 2022] POST /identity/v3/roles => generated 219 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:43:57.204924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:57.206473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:57.283236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 14/30] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:57.306464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:57.317453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7997be-a25e-43af-8af8-1242a59a207c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:57.322386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:57.323256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.323532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.323806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.340268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:43:57.349369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:43:57.353397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 17/31] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:43:57.359466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:57.377929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf67b8-deef-438e-b6df-636d6555e1db None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:57.385444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:57.386151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.386428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.386699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.387498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:43:57.387801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:57.389095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:57.389095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:43:57.389095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:43:57.390034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:57.408927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 15/32] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:57.414705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:57.426296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac61e-c17d-41ae-82d1-cde645a3782d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:57.437005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:57.438418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.438913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.439412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.445845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:57.448294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:57.450345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 18/33] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:43:57 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:57.456092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:57.466369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a250e0b-23d6-46a7-94a3-aa8f111a105b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:57.477327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5fbc-76ef-4dbf-a5c8-4d6aafb2ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:57.478187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5fbc-76ef-4dbf-a5c8-4d6aafb2ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.478470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5fbc-76ef-4dbf-a5c8-4d6aafb2ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.478745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5fbc-76ef-4dbf-a5c8-4d6aafb2ec07 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.483387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de5fbc-76ef-4dbf-a5c8-4d6aafb2ec07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:57.485234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de5fbc-76ef-4dbf-a5c8-4d6aafb2ec07 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:57.487492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 16/34] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:57.493493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:57.504680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fa55-f062-4471-b82e-772ed5be7d88 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:57.517457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:57.518343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.518652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.518913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] PATH_INFO: `/v3/domains/default/users/fbd82c2696a04c4883c8116f54cc6d64/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.526827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fbd82c2696a04c4883c8116f54cc6d64, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:57.528010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:57.528010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:43:57.528010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:43:57.530107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d125cf-7f13-437b-902a-6f03b0cc58a5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:57.565442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 19/35] 10.222.0.31 () {58 vars in 1382 bytes} [Thu Feb 3 02:43:57 2022] PUT /identity/v3/domains/default/users/fbd82c2696a04c4883c8116f54cc6d64/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:43:57.825807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33993317-663d-4ddd-a2c7-4af1367edbd8 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.826284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33993317-663d-4ddd-a2c7-4af1367edbd8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.826284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33993317-663d-4ddd-a2c7-4af1367edbd8 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.828214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 17/36] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:57.834403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620e38-4158-4277-8e05-17a00212180a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.835310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620e38-4158-4277-8e05-17a00212180a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.835790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620e38-4158-4277-8e05-17a00212180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.854471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-28620e38-4158-4277-8e05-17a00212180a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:57.856376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-28620e38-4158-4277-8e05-17a00212180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:57.914821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 20/37] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:57.940898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33993317-663d-4ddd-a2c7-4af1367edbd8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:57.954954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33993317-663d-4ddd-a2c7-4af1367edbd8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:57.960114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:57.961317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:57.961805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:57.962275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:57.963311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:57.964687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:43:57.964687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:43:57.964687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:43:57.966060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843fe02-4f73-45e1-b4d8-78142056804d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:57.986737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 18/38] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:43:57 2022] POST /identity/v3/roles => generated 225 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:43:58.196701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1ad0-1300-4055-99bc-831f485c7f6f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.197342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1ad0-1300-4055-99bc-831f485c7f6f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.197765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1ad0-1300-4055-99bc-831f485c7f6f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.199824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 21/39] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:58.205856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.206155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.206437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.224672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:58.224869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d0f1-997d-4311-b4f1-4e194d869065 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.225072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d0f1-997d-4311-b4f1-4e194d869065 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.225316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d0f1-997d-4311-b4f1-4e194d869065 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.225874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:58.227369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 22/40] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:58.232641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.232966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.233262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.233805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 19/41] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:58.251783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:58.253010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:58.257012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:58.261113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 23/42] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:43:58.266237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313090a7-68c6-48fc-b09e-d07e1e78d48d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:58.270624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:58.271288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.271576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.271842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.272607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:58.274278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:58.284161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:58.288995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 20/43] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:43:58 2022] POST /identity/v3/roles => generated 223 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:43:58.293661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0763-1cf7-4476-96a0-190e05779814 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:58.298415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d399b-0e27-4daa-8e8b-96726cbdc59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:58.299252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d399b-0e27-4daa-8e8b-96726cbdc59c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.299535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d399b-0e27-4daa-8e8b-96726cbdc59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.299807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d399b-0e27-4daa-8e8b-96726cbdc59c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.301143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d399b-0e27-4daa-8e8b-96726cbdc59c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:58.302973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d399b-0e27-4daa-8e8b-96726cbdc59c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:58.304953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 24/44] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:43:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:43:58.310737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:58.321280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089179b-3106-4e5c-9450-78428e835f9d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:58.325882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e015756-e789-4041-a34f-efabbba43edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:58.326573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e015756-e789-4041-a34f-efabbba43edb admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:58.326860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e015756-e789-4041-a34f-efabbba43edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:58.327148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e015756-e789-4041-a34f-efabbba43edb admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:58.327924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e015756-e789-4041-a34f-efabbba43edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:58.330021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e015756-e789-4041-a34f-efabbba43edb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:43:58.359364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 21/45] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:43:58 2022] POST /identity/v3/projects => generated 312 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:43:59.817979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b89a3-4bd4-49c1-8495-5e0fcebba182 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:59.818512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b89a3-4bd4-49c1-8495-5e0fcebba182 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:59.818512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b89a3-4bd4-49c1-8495-5e0fcebba182 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:59.820340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 25/46] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:43:59.825798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:59.826189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:59.826366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:59.844663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:43:59.845898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:43:59.904012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 22/47] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:43:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:43:59.927599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b89a3-4bd4-49c1-8495-5e0fcebba182 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:59.941882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b89a3-4bd4-49c1-8495-5e0fcebba182 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:59.946778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:59.947574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:59.947851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:59.948125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:59.958648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:43:59.965433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:43:59.966604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 26/48] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:43:59.972382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:43:59.981904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29e6ce-d630-4470-8ae8-90cdf5ceaf50 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:43:59.988076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:43:59.988771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:43:59.989052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:43:59.989326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:43:59.990108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:43:59.990416 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:43:59.992068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:00.000997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 23/49] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:00.006723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:00.018671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e981a-82b1-4e18-bcc6-1c792b1355aa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:00.024500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:00.025400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.025683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.025964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.027313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:00.029211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:00.030963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 27/50] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:00 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:00.036442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:00.046960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c3e5-79c7-4a3a-8892-7af1ebb7e9fb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:00.052919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f99370-573c-4d92-a53d-c6d8948f44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:00.053712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99370-573c-4d92-a53d-c6d8948f44d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.053994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99370-573c-4d92-a53d-c6d8948f44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.054268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99370-573c-4d92-a53d-c6d8948f44d5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.055638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99370-573c-4d92-a53d-c6d8948f44d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:00.057396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99370-573c-4d92-a53d-c6d8948f44d5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:00.058987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 24/51] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:00.064660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:00.076272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46ee01-cd69-4958-b974-bfd4966718f8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:00.081752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:00.082423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.082698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.082970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.084081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.domain.id=default, user.id=fbd82c2696a04c4883c8116f54cc6d64) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:00.084081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:00.085163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:00.085163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:00.085163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:00.086332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d2071-62e3-47b2-91e7-797681733d24 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:00.094226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 28/52] 10.222.0.31 () {56 vars in 1343 bytes} [Thu Feb 3 02:44:00 2022] GET /identity/v3/role_assignments?user.id=fbd82c2696a04c4883c8116f54cc6d64&scope.domain.id=default&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 530 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:00.556618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122ee0-b732-43f9-9357-4be4c22c8c10 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.557060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122ee0-b732-43f9-9357-4be4c22c8c10 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.557518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122ee0-b732-43f9-9357-4be4c22c8c10 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.560362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 25/53] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:00.567944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.568350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.568797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.596702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:00.597950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:00.606854 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 29/54] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:00.630446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122ee0-b732-43f9-9357-4be4c22c8c10 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:00.645757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122ee0-b732-43f9-9357-4be4c22c8c10 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:00.651731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9b58-e087-42f9-ac94-f9d2efb97c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:00.652504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9b58-e087-42f9-ac94-f9d2efb97c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.652805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9b58-e087-42f9-ac94-f9d2efb97c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.653078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9b58-e087-42f9-ac94-f9d2efb97c4d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.654393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9b58-e087-42f9-ac94-f9d2efb97c4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:00.656114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9b58-e087-42f9-ac94-f9d2efb97c4d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:00.657770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 26/55] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:00.663583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:00.677966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231576-dafb-4d0b-bcc2-93e700daee98 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:00.686919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:00.687970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:00.688271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:00.688541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:00.689293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:00.690334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:00.690334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:00.690334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:00.691555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318563eb-b11c-411d-a8b1-d11fa1f58305 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:00.721888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 30/56] 10.222.0.31 () {60 vars in 1161 bytes} [Thu Feb 3 02:44:00 2022] POST /identity/v3/projects => generated 298 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:02.888596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fdfa7-5bc8-4407-a671-6713154d8b94 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:02.889236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fdfa7-5bc8-4407-a671-6713154d8b94 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:02.889236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fdfa7-5bc8-4407-a671-6713154d8b94 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:02.891021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 27/57] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:02.897456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:02.898107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:02.898494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:02.920070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:02.921300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:02.980949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 31/58] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:03.005783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fdfa7-5bc8-4407-a671-6713154d8b94 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:03.021618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fdfa7-5bc8-4407-a671-6713154d8b94 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:03.027877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0014-a4db-433e-82b1-c3e48a31d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:03.028655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0014-a4db-433e-82b1-c3e48a31d85a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:03.028983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0014-a4db-433e-82b1-c3e48a31d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:03.029260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0014-a4db-433e-82b1-c3e48a31d85a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:03.030603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed0014-a4db-433e-82b1-c3e48a31d85a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:03.032308 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed0014-a4db-433e-82b1-c3e48a31d85a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:03.033901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 28/59] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:03.039738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:03.051757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb337d-cc72-40ae-990f-e069fa4174a4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:03.057518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:03.058173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:03.058456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:03.058719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:03.059438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:03.060470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:03.060470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:03.060470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:03.061736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4a5ff-3759-4598-8488-3fde57f3e43e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:03.090751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 32/60] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:03 2022] POST /identity/v3/users => generated 275 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:06.238705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21909d9-292e-4672-8496-d590bbf30996 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.239214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21909d9-292e-4672-8496-d590bbf30996 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.239283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21909d9-292e-4672-8496-d590bbf30996 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.241339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 29/61] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:06.246865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.247258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.247439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.269697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:06.271238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:06.279719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 33/62] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:06.315008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21909d9-292e-4672-8496-d590bbf30996 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.334508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21909d9-292e-4672-8496-d590bbf30996 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.338999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.339795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.340082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.340355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.362891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:06.369829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:06.371083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 30/63] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:06.376955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.390339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c9298-b748-4661-aff9-9dc47a7dbf5d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.406748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.407821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.408320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.408833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.409841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:06.410338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.412417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.432794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 34/64] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.439044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.467309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53b7f-9ddb-4a56-a6f7-e722e6fad08d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.472843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.473736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.474021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.474298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.481751 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.483628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.485744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 31/65] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.491340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.505714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa6fb-934e-4ddf-a7d7-f149650fc4a0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.515516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.516465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.517007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.517507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.532510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.534619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.550529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 35/66] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:06.556226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.566286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187567-da21-4eec-9e5a-cbfd553a981c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.576784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fc9bf-c516-4edd-aefd-829734bcf8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.577660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fc9bf-c516-4edd-aefd-829734bcf8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.577943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fc9bf-c516-4edd-aefd-829734bcf8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.578212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fc9bf-c516-4edd-aefd-829734bcf8b5 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.579503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fc9bf-c516-4edd-aefd-829734bcf8b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.585034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fc9bf-c516-4edd-aefd-829734bcf8b5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.587096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 32/67] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.592612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.605532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221470d-a9ad-4bf4-b75d-fac73593039a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.613287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.614189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.614660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.615120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.616187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=fbd82c2696a04c4883c8116f54cc6d64) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:06.616746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.618892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb3bd-bd2e-426c-ad92-887780ea752b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.629074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 36/68] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/role_assignments?user.id=fbd82c2696a04c4883c8116f54cc6d64&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.695128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a9b56-deae-4c2c-96de-693408ae97e8 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.695478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a9b56-deae-4c2c-96de-693408ae97e8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.695702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a9b56-deae-4c2c-96de-693408ae97e8 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.697614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 33/69] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:06.703962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e41e-d65e-4607-b784-b3e34d798895 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.704254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e41e-d65e-4607-b784-b3e34d798895 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.704537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e41e-d65e-4607-b784-b3e34d798895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.729183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c560e41e-d65e-4607-b784-b3e34d798895 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:06.730438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c560e41e-d65e-4607-b784-b3e34d798895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:06.739220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 37/70] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:06.739863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52d1b7-18fe-40e0-9a7d-c53de2eb6aa8 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.740155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52d1b7-18fe-40e0-9a7d-c53de2eb6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.740436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52d1b7-18fe-40e0-9a7d-c53de2eb6aa8 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.741334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb56c-1c9a-4360-93ee-a11cfca740ef None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.741762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb56c-1c9a-4360-93ee-a11cfca740ef None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.742171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb56c-1c9a-4360-93ee-a11cfca740ef None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.742269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 34/71] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:06.744167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 38/72] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:06.747791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.748069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.748344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.751793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.752357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.752880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.773537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:06.775359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:06.780749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:06.781185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:06.791170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 39/73] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:06.791860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.802741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6270c-b88c-4a3a-bf43-4073534ffcd2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.803587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 35/74] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:06.807908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.809072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.809557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.810021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.822556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:06.830081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:06.831677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 40/75] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:06.836688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.837931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.848888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94889-71f0-4a26-a921-5f8d7cdaac9b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.850772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd82c3-0a7b-4b2d-80f0-de8259c76095 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.853573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.854413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.854693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.854983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.856760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.857773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.858491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.859333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.869068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:06.871537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:06.878458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:06.879877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 41/76] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:06.880820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:06.881150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.882569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 36/77] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:06.888428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.898258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8eedd-8802-4a5f-a563-a05bccb24ae4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.901630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77317b7-3e09-4e1f-919d-8e3d80f568e7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.903092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.903832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.904124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.904527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.905567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:06.905892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.907789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.908204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.909149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.909881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.910800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.911822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:06.912333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.914938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.918567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 42/78] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.923572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.930407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903c3e9-515f-40bf-89ee-804da23b786d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.933356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 37/79] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.934412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.945361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.946325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.946624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.946902 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.947685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:06.947994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.949365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4a95-d0db-4903-a579-a48a02ba6dd3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.949691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.955002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.956546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.957201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.957837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.959496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 43/80] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.964568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.971075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f0cc-9eaf-4a4d-98d1-0af02ebfa04a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:06.976463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:06.977483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:06.977766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:06.978044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:06.982496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.985061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:06.992191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 38/81] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:06.993423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:06.997265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:06.999453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.002326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 44/82] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.005394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.009604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5a0c7-ebb3-45a2-9baa-0209ece63dba admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.016186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.017378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.017968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.018453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.019286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681de2-d1a1-4f23-9813-e16a245df6b8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.020199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.023404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.023952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.024703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.025128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.025515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.026326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 39/83] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:06 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.027227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.037815 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3539ee-fe9f-45a5-8c7c-ff954a74f965 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.038657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.040578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.042817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.043641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.044077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.044487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.050223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 45/84] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:07.053407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.055342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.055657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.064672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7572049-0204-4071-a3ce-1a6b8a063298 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.065361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 40/85] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:07.066453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.076867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.077384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2277-176c-4865-9ff4-b3a9bbfb7cfd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.077999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.078535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.079011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.082909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.083985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.084458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.085015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] PATH_INFO: `/v3/projects/0a34dcee960749a99c13171ae150cfc2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.087315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a34dcee960749a99c13171ae150cfc2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.088577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.090314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.090487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.092437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 41/86] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/projects/0a34dcee960749a99c13171ae150cfc2 => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.093532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.104025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e8f0-c152-460f-ade2-ac3c5dac5915 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.105698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 46/87] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:07.106383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.114885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.115758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.116043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.116331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.118249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.120470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.120883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ce401-bb78-4aac-892d-b1cee2583c66 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.124856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 42/88] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.125947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.132912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.133645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.133938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.134223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.135420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=0a34dcee960749a99c13171ae150cfc2, user.id=8784429d70b64e1da535a7547d9c0b2c) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:07.135784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.137307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78bb70-cee5-473e-810f-5f3c99f566b9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.137723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.142232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.143287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.143786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.144418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 47/89] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/role_assignments?user.id=8784429d70b64e1da535a7547d9c0b2c&scope.project.id=0a34dcee960749a99c13171ae150cfc2&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.144694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.145099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.153954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.158984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.165613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 43/90] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.169685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.171144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24a6f-f2f2-4685-ae82-38ad8a6950ea admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.178432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.179117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.179397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.179757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.180629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=8784429d70b64e1da535a7547d9c0b2c) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:07.180985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.182787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8807115-84e3-4b21-859c-95feba3288a4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.183071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e41451-d15a-408f-a59b-25a6d91b65b6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.188382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.189537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.189659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 48/91] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/role_assignments?user.id=8784429d70b64e1da535a7547d9c0b2c&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.190466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.190965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.191061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4b5d-c0fc-43bd-8bea-cfa8d8b43521 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.191340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4b5d-c0fc-43bd-8bea-cfa8d8b43521 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.191612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4b5d-c0fc-43bd-8bea-cfa8d8b43521 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.192573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] RBAC: Adding query filter params (role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=8784429d70b64e1da535a7547d9c0b2c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:07.193175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.193345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 49/92] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:07.195594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.199209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.199496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.199774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.203291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 44/93] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/role_assignments?user.id=8784429d70b64e1da535a7547d9c0b2c&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:07.219557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:07.221260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:07.229860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 50/94] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:07.256408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.272323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf5cd-7e57-48ab-b939-38066d202a8b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.278221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffbc5-a2a5-45c4-8a8e-3d725ceeaea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.279135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffbc5-a2a5-45c4-8a8e-3d725ceeaea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.279512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffbc5-a2a5-45c4-8a8e-3d725ceeaea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.279860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffbc5-a2a5-45c4-8a8e-3d725ceeaea6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.281291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffbc5-a2a5-45c4-8a8e-3d725ceeaea6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.290004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffbc5-a2a5-45c4-8a8e-3d725ceeaea6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.292504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 45/95] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:07.298976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:07.314402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed2a7-2500-4ae0-b1f2-69da1b806b1e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:07.324386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b7a2f-d651-493e-8fc8-57d623c5f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:07.325459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b7a2f-d651-493e-8fc8-57d623c5f76e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:07.325971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b7a2f-d651-493e-8fc8-57d623c5f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:07.326410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b7a2f-d651-493e-8fc8-57d623c5f76e admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:07.327446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b7a2f-d651-493e-8fc8-57d623c5f76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:07.329938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b7a2f-d651-493e-8fc8-57d623c5f76e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:07.376010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 51/96] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:07 2022] POST /identity/v3/users => generated 289 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:09.076324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a03835-47b7-4d29-a86c-870c2fe0aa59 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.076890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a03835-47b7-4d29-a86c-870c2fe0aa59 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.076890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a03835-47b7-4d29-a86c-870c2fe0aa59 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.078992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 46/97] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:09.084951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.085336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.085589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.114613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:09.115813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:09.126823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 52/98] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:09.161215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a03835-47b7-4d29-a86c-870c2fe0aa59 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:09.178475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a03835-47b7-4d29-a86c-870c2fe0aa59 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:09.182820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:09.183677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.183966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.184240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.198069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:09.204904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:09.206122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 47/99] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:09.212085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:09.225972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c88a9-5003-48ce-b859-73a5b7e0726a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:09.230620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:09.231782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.232298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.232830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.234013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:09.234327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:09.236184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:09.248358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 53/100] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:09.254185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:09.269762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46a67-1c56-4ecc-aef5-5d448cb2582d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:09.275236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:09.275236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.277527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.277527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.277527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:09.278710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:09.280375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 48/101] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:09 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:09.288440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:09.304163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc54ce7-8ba8-43d3-9558-b64666931da2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:09.312708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325b24f-dee5-46a9-a80d-bf12c68f8dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:09.313809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325b24f-dee5-46a9-a80d-bf12c68f8dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.314129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325b24f-dee5-46a9-a80d-bf12c68f8dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.314407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325b24f-dee5-46a9-a80d-bf12c68f8dfe admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.315662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325b24f-dee5-46a9-a80d-bf12c68f8dfe admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:09.317844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325b24f-dee5-46a9-a80d-bf12c68f8dfe admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:09.319743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 54/102] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:09 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:09.325367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:09.337851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7732fbf-1f72-4261-abee-5a66583d2dd0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:09.342241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:09.343153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:09.343437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:09.343714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/fbd82c2696a04c4883c8116f54cc6d64/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:09.350083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de8007f03248b1ae1b7efb76862307, user_id=fbd82c2696a04c4883c8116f54cc6d64, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:09.351131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:09.351131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:44:09.351131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:44:09.353134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029cd51-ae8e-46c4-b3eb-6e8a800da59e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:09.376212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 49/103] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:09 2022] PUT /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/fbd82c2696a04c4883c8116f54cc6d64/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:10.003403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed361-ab49-4fed-8b9a-064b8564dc20 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.003824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed361-ab49-4fed-8b9a-064b8564dc20 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.004001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed361-ab49-4fed-8b9a-064b8564dc20 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.005790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 55/104] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:10.011218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b104-f554-4bf9-aa08-b2a8df747f47 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.011511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b104-f554-4bf9-aa08-b2a8df747f47 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.011788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b104-f554-4bf9-aa08-b2a8df747f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.041801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9822b104-f554-4bf9-aa08-b2a8df747f47 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:10.043096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9822b104-f554-4bf9-aa08-b2a8df747f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:10.122587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 50/105] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:10.140471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d5d4-39eb-4bf9-918d-f92f88808683 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.141198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d5d4-39eb-4bf9-918d-f92f88808683 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.141198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d5d4-39eb-4bf9-918d-f92f88808683 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.142946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 56/106] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:10.158312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.158588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.158846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.159844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d5d4-39eb-4bf9-918d-f92f88808683 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.181014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d5d4-39eb-4bf9-918d-f92f88808683 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.189496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.190304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.190588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.190863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.213737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:10.214950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:10.216764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:10.227044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:10.228273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 57/107] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:10.234197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.234757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 51/108] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:10.255081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d996b-6d1a-4912-b520-d8629c1f28db admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.264224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.264915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.265200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.265471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.266349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:10.266656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.268287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.284345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 58/109] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.289753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.305230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.307111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6493-ca4f-441f-b2f9-58b63c4923a0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.320262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38d38-f4f6-4f72-9804-c9ee95cc4fb1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.322593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.323493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.323765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.324040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.325495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899874-8c23-4722-a8f7-81b3a4103809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.326299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899874-8c23-4722-a8f7-81b3a4103809 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.326635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899874-8c23-4722-a8f7-81b3a4103809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.326857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899874-8c23-4722-a8f7-81b3a4103809 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.329459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.331661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.333599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 52/110] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.339994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.349995 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d899874-8c23-4722-a8f7-81b3a4103809 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:10.358994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fccf-d975-479c-998a-392a920a6ee2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.360496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-0d899874-8c23-4722-a8f7-81b3a4103809 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:10.361963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 59/111] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:10.364220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ea44-caf9-4f76-ba8f-f02605b90eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.365290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea44-caf9-4f76-ba8f-f02605b90eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.365708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea44-caf9-4f76-ba8f-f02605b90eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.366116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea44-caf9-4f76-ba8f-f02605b90eb5 admin admin] PATH_INFO: `/v3/projects/0a34dcee960749a99c13171ae150cfc2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.367519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ea44-caf9-4f76-ba8f-f02605b90eb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a34dcee960749a99c13171ae150cfc2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.367629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e122cd-9342-459f-92b7-d5f97a552549 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.368035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e122cd-9342-459f-92b7-d5f97a552549 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.368465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e122cd-9342-459f-92b7-d5f97a552549 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.370157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ea44-caf9-4f76-ba8f-f02605b90eb5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.370591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 60/112] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:10.371439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e122cd-9342-459f-92b7-d5f97a552549 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.372314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 53/113] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/projects/0a34dcee960749a99c13171ae150cfc2 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:10.377808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.378268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.378690 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.394320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e122cd-9342-459f-92b7-d5f97a552549 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.397587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:10.398976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:10.405355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.406185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.406619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.406987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.407867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:10.408283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.408554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 54/114] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:10.409568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.412767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.427675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 61/115] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.429324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525e50-64c2-454f-8b30-782bc2b858af None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.433987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.442407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.443309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.443585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.444433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] PATH_INFO: `/v3/projects/0a34dcee960749a99c13171ae150cfc2/users/8784429d70b64e1da535a7547d9c0b2c/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.446637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a34dcee960749a99c13171ae150cfc2, user_id=8784429d70b64e1da535a7547d9c0b2c, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.449515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.450944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe2686-e00e-431b-9a01-c830171250df admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.461085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.461966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.463252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.463530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.464830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.467142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.469551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 62/116] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.472362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.477408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 55/117] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:10 2022] PUT /identity/v3/projects/0a34dcee960749a99c13171ae150cfc2/users/8784429d70b64e1da535a7547d9c0b2c/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:10.478289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.497739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6d82-cdf9-47c4-a5e0-d946abe1f087 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.574588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.575315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.575638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.575913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.597940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105b19-538d-46af-ad5c-b2d2fae19254 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.599458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:10.609061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.610067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.611793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.612081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.613706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:10.615537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.617177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 63/118] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:10.618266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.620460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 56/119] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.627378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.634264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.645850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527472f-5103-4530-a0ba-7afc2d35261f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.652066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedc58c-629b-4228-880a-7a4a40f5b6bf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.656833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.659019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.659312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.659594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/8784429d70b64e1da535a7547d9c0b2c/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.660824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.662057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.662342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.663153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.664585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:10.664928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.666861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de8007f03248b1ae1b7efb76862307, user_id=8784429d70b64e1da535a7547d9c0b2c, role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.669809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.670781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.686709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 64/120] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:10 2022] PUT /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/8784429d70b64e1da535a7547d9c0b2c/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:10.688062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 57/121] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:10.706562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.775921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83095de8-1f7e-40a4-a1b6-6431fe4421ab admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.781427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.782420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.782751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.783118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.784510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.786868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.788610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 65/122] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.794297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.805029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ec9d-51ea-4d44-810b-0eb9eb1b1266 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.809960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84225-7d4f-4617-83ea-3ef77def52d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.810928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84225-7d4f-4617-83ea-3ef77def52d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.811212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84225-7d4f-4617-83ea-3ef77def52d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.811489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84225-7d4f-4617-83ea-3ef77def52d8 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.813003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84225-7d4f-4617-83ea-3ef77def52d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.815253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84225-7d4f-4617-83ea-3ef77def52d8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.817274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 58/123] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:10 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:10.823441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:10.834341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824491fa-2729-4baa-8810-a59a34161a07 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:10.839131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b210f94-f1cc-48af-92a5-64af1451abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:10.840093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b210f94-f1cc-48af-92a5-64af1451abb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:10.840422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b210f94-f1cc-48af-92a5-64af1451abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:10.840701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b210f94-f1cc-48af-92a5-64af1451abb5 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/8784429d70b64e1da535a7547d9c0b2c/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:10.842844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b210f94-f1cc-48af-92a5-64af1451abb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de8007f03248b1ae1b7efb76862307, user_id=8784429d70b64e1da535a7547d9c0b2c, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:10.845930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b210f94-f1cc-48af-92a5-64af1451abb5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:10.868073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 66/124] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:10 2022] PUT /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/8784429d70b64e1da535a7547d9c0b2c/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:11.197455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2afce-6893-4754-83d5-6c63c6fec7f4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.198014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2afce-6893-4754-83d5-6c63c6fec7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.198014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2afce-6893-4754-83d5-6c63c6fec7f4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.199883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 59/125] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:11.208023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.208692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.208692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.233772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:11.235078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:11.303458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 67/126] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:11.346937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2afce-6893-4754-83d5-6c63c6fec7f4 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.362789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2afce-6893-4754-83d5-6c63c6fec7f4 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.370127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.370941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.371224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.371505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.382481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:11.389199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:11.390484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 60/127] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:11.396258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.405500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ffe7-754e-4b39-a9c2-2fefd2104477 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.415625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.416308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.416592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.417009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.417787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:11.418095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.419737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e66d19-2bf4-4428-b469-9e037841b21b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.428817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 68/128] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:11.434295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.444947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb881c0-042e-4296-b56f-39de4a831305 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.452761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.453624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.453894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.454143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] PATH_INFO: `/v3/users/7f762359d36342598c933cede26ae953` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.462199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729ea4b-298b-4736-b35c-8df3f034c6dd None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.462487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729ea4b-298b-4736-b35c-8df3f034c6dd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.462766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729ea4b-298b-4736-b35c-8df3f034c6dd None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.464556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 69/129] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:11.470064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.470348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.470623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.487802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f762359d36342598c933cede26ae953)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.491003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.491772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 61/130] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/users/7f762359d36342598c933cede26ae953 => generated 289 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:11.501746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:11.503022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:11.504759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.515521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c9be-db93-48f5-8a35-003d90d36794 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.518937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 70/131] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:11.526232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.526887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.527172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.527450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.535986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.541854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.550979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 62/132] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:11.556953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.566714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecc8e3-1090-426e-be56-cd05b3198516 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.568284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.579352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.580228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.580504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.580804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.583241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193839e-d116-410e-9fa1-8e460da40ff1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.584481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.586615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.588291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 71/133] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:11.592234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.593058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.593341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.594517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.595269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.598799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.600497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.602259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 63/134] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:11.609063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffdb59-048a-407a-a338-4aa2c08a58c2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.610569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:11.622078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.622736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.623024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.623188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8e5a-02bf-4897-9583-f6882d207073 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:11.623369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.624134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] RBAC: Adding query filter params (role.id=cb22f0ef0c8a43869b3790774444735a, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=7f762359d36342598c933cede26ae953) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:11.624448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.626457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf425785-b0b4-41ef-a200-bc0f826c8fbf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.633911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 72/135] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:11 2022] GET /identity/v3/role_assignments?user.id=7f762359d36342598c933cede26ae953&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=cb22f0ef0c8a43869b3790774444735a => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:11.636206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53e47-b9d2-46f7-bd8a-9f7470a4385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:11.640757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53e47-b9d2-46f7-bd8a-9f7470a4385a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:11.640757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53e47-b9d2-46f7-bd8a-9f7470a4385a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:11.640757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53e47-b9d2-46f7-bd8a-9f7470a4385a admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:11.640757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53e47-b9d2-46f7-bd8a-9f7470a4385a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:11.640757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53e47-b9d2-46f7-bd8a-9f7470a4385a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:11.669034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 64/136] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:44:11 2022] POST /identity/v3/projects => generated 302 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:12.664450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec5643-7d1a-4100-91d6-2a0be429406f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.665543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec5643-7d1a-4100-91d6-2a0be429406f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.666030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec5643-7d1a-4100-91d6-2a0be429406f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.668120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 73/137] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:12.673798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.674620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.675136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.695295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:12.696860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:12.755324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 65/138] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:12.779371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec5643-7d1a-4100-91d6-2a0be429406f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:12.792165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec5643-7d1a-4100-91d6-2a0be429406f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:12.796916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:12.798010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.798490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.799021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.813542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:12.820475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:12.821922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 74/139] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:12.829689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:12.839031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399a75-b389-46f6-bc41-bf2fe125bfa0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:12.848915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:12.849868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.850369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.850841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.851831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:12.852340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:12.854203 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:12.863655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 66/140] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:12.869585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:12.882793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c9f5-6264-4de8-9dbf-3f6946f6bde6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:12.891994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:12.893168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.893650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.894119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] PATH_INFO: `/v3/users/fbd82c2696a04c4883c8116f54cc6d64` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.895526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd82c2696a04c4883c8116f54cc6d64)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:12.897705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:12.899541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 75/141] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:12 2022] GET /identity/v3/users/fbd82c2696a04c4883c8116f54cc6d64 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:12.905315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:12.915688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae7da-0aa8-4de3-8e9b-e3c79b56cfd6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:12.920504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:12.921445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.922033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.922559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.931526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:12.933731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:12.953829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 67/142] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:12.956433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:12.967803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce5ff2-90c4-4b38-a6e3-04ab825f571a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:12.973606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78912278-6089-4b9f-9815-af33e4be531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:12.974864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78912278-6089-4b9f-9815-af33e4be531c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:12.975337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78912278-6089-4b9f-9815-af33e4be531c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:12.975827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78912278-6089-4b9f-9815-af33e4be531c admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:12.977399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78912278-6089-4b9f-9815-af33e4be531c admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:12.979883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78912278-6089-4b9f-9815-af33e4be531c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:12.981895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 76/143] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:12 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:12.988593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:12.998331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb2cf6-fba9-43e5-b54f-ba35ac860110 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:13.004106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:13.005110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:13.005703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:13.006165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:13.007269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=fbd82c2696a04c4883c8116f54cc6d64) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:13.007773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:13.010037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf60cb-f206-4d61-82fa-a788083b5529 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:13.016960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 68/144] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:12 2022] GET /identity/v3/role_assignments?user.id=fbd82c2696a04c4883c8116f54cc6d64&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:13.935097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2778a-69b8-4903-9b87-ed730641f173 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:13.936123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2778a-69b8-4903-9b87-ed730641f173 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:13.936596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2778a-69b8-4903-9b87-ed730641f173 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:13.938638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 77/145] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:13.944231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:13.944675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:13.944921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:13.968573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:13.969840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:13.982806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 69/146] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:14.006541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2778a-69b8-4903-9b87-ed730641f173 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.018932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2778a-69b8-4903-9b87-ed730641f173 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.028350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.029200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.029482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.029761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.049035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:14.056108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:14.057446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 78/147] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:14.063894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.076881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b87f-f1fa-4761-93c7-6b9e853e3890 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.085119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.085388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.085604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.085825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.088778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.088778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.088778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.104015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 70/148] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.109656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.119925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026836-a07d-4eee-bf19-8cdbb31a7904 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.128297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.129195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.129473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.129748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.130965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.133210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.134830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 79/149] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.140290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.153786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b970748-52f4-44fe-8da6-ebbd4fbfa08e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.158383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.159058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.159337 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.159608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.173512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.175335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.191094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 71/150] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:14.196651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.207297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98996d-c007-4579-b9d5-5a21c24d7f7a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.216295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce616-4daa-475a-8d87-69b8ecf0e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.217185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce616-4daa-475a-8d87-69b8ecf0e6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.217467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce616-4daa-475a-8d87-69b8ecf0e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.217732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce616-4daa-475a-8d87-69b8ecf0e6a4 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.218960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce616-4daa-475a-8d87-69b8ecf0e6a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.221072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce616-4daa-475a-8d87-69b8ecf0e6a4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.222761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 80/151] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.228623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.238145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d3f0-46b9-4b8f-850d-c17618b28165 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.248255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.248938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.249221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.249497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.250412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=8784429d70b64e1da535a7547d9c0b2c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.250724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.252601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9b02e-dbd1-4ec7-8d8a-c34e58ddd027 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.258973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 72/152] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/role_assignments?user.id=8784429d70b64e1da535a7547d9c0b2c&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.318728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029d06e-4301-47de-9271-73386eac916f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.319020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029d06e-4301-47de-9271-73386eac916f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.319263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029d06e-4301-47de-9271-73386eac916f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.321542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 81/153] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:14.328368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.328368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.328368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.358026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:14.359683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:14.368658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 73/154] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:14.400327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029d06e-4301-47de-9271-73386eac916f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.417251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029d06e-4301-47de-9271-73386eac916f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.424399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.425240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.425520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.425787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.440979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:14.447877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:14.449123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 82/155] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:14.455104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.471516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9abd32-1172-4621-9339-b6aa0330d6c6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.480978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.481969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.482420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.482855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.483805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.484360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.490479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.505888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 74/156] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.511645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.525246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc8c60-82df-4327-b8e2-25e132c7906f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.530301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8002-7719-4db2-aac0-8cf478576702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.531504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8002-7719-4db2-aac0-8cf478576702 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.531949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8002-7719-4db2-aac0-8cf478576702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.532382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8002-7719-4db2-aac0-8cf478576702 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.534440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e8002-7719-4db2-aac0-8cf478576702 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.536839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e8002-7719-4db2-aac0-8cf478576702 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.538937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 83/157] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.544525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.556037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47d787-9468-4e29-a0fd-05da7f6e3f52 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.563472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.564138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.564420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.564695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.576593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.578525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.589781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 75/158] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:14.592522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266fdd6-97a3-4c67-8101-694b915439bd None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.593020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266fdd6-97a3-4c67-8101-694b915439bd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.593462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266fdd6-97a3-4c67-8101-694b915439bd None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.595523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 84/159] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:14.596105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.601201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81923b-ee6c-4cd5-ab06-73f2aac5d28e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.601696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81923b-ee6c-4cd5-ab06-73f2aac5d28e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.602131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81923b-ee6c-4cd5-ab06-73f2aac5d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.606069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e556e-a098-4acc-a548-b4c37b992ba5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.615905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14450cba-83b6-403d-b81d-6e2f0c177c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.616836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14450cba-83b6-403d-b81d-6e2f0c177c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.617126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14450cba-83b6-403d-b81d-6e2f0c177c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.617404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14450cba-83b6-403d-b81d-6e2f0c177c84 admin admin] PATH_INFO: `/v3/projects/0a34dcee960749a99c13171ae150cfc2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.618730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14450cba-83b6-403d-b81d-6e2f0c177c84 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a34dcee960749a99c13171ae150cfc2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.620951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14450cba-83b6-403d-b81d-6e2f0c177c84 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.623152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 76/160] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/projects/0a34dcee960749a99c13171ae150cfc2 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:14.624538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606849ac-a494-4fc2-b269-e8ade0c0be43 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.624861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606849ac-a494-4fc2-b269-e8ade0c0be43 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.625225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606849ac-a494-4fc2-b269-e8ade0c0be43 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.627044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 77/161] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:14.629118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-db81923b-ee6c-4cd5-ab06-73f2aac5d28e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:14.630589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-db81923b-ee6c-4cd5-ab06-73f2aac5d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:14.631016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606849ac-a494-4fc2-b269-e8ade0c0be43 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.641129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 85/162] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:14.642595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.642877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.643205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.645796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606849ac-a494-4fc2-b269-e8ade0c0be43 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.650364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.651030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.651309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.652435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.652435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=0a34dcee960749a99c13171ae150cfc2, user.id=8784429d70b64e1da535a7547d9c0b2c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.652745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.654658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.663218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 78/163] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/role_assignments?user.id=8784429d70b64e1da535a7547d9c0b2c&scope.project.id=0a34dcee960749a99c13171ae150cfc2&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.663942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:14.665446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:14.673073 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.674327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 86/164] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:14.685131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec2a4b-e567-4622-a0f3-5250b6516b73 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.689905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.690819 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.691099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.691369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.697986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.704266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:14.707565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04210405-9d68-4abe-898f-71d3dc9ec159 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.711624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:14.712128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.712952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 79/165] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:14.713315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.713599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.713872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.718928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.727245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:14.729535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faddd0-9f52-401f-bdbd-fface720bf4e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.734089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.734694 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:14.734871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.735121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.735389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.736028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 87/166] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:14.736505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.740964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.743155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.745759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.754267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 80/167] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.760021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b62b11-eb5d-4f96-b165-8e2da5a7bd64 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.760241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.765549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.767377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.767886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.768682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.769751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.770265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.770878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff20f1-dc45-4220-aa82-9bcd8c16993f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.772576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.776608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.781246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.781677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.782048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] PATH_INFO: `/v3/users/8784429d70b64e1da535a7547d9c0b2c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.784609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] RBAC: Authorizing `identity:get_user(user_id=8784429d70b64e1da535a7547d9c0b2c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.787001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.789067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 88/169] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.793565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 81/169] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/users/8784429d70b64e1da535a7547d9c0b2c => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.795322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.796307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.807544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7445a-673d-4fb7-9cb3-537372fedb54 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.809628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d08c3-895e-4656-bb3e-b8b488a31635 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.813345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.814538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.814660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.815098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.815532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.815719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] PATH_INFO: `/v3/users/7f762359d36342598c933cede26ae953` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.815921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.816332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.817736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f762359d36342598c933cede26ae953)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.820121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.822375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 89/170] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/users/7f762359d36342598c933cede26ae953 => generated 289 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:14.828322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.833662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.836859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.839747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01555be7-9ef7-4523-8b23-4adae1d54074 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.844565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.845445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.845726 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.846002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.847259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.849451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.850620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 82/171] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:14.851640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 90/172] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:14.857269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.857421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.868122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a45fb-34e3-4ad8-99dc-0c7ee8486b7e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.868527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b12269-d571-47a3-b4a4-e8213db18f5c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.872434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1d1d-03e4-498d-b523-9683161b48d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.873263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96535482-8f03-4452-b208-535396131550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.873379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1d1d-03e4-498d-b523-9683161b48d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.873940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1d1d-03e4-498d-b523-9683161b48d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.873940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1d1d-03e4-498d-b523-9683161b48d1 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/7f762359d36342598c933cede26ae953/roles/cb22f0ef0c8a43869b3790774444735a` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.874109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96535482-8f03-4452-b208-535396131550 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.874566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96535482-8f03-4452-b208-535396131550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.874670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96535482-8f03-4452-b208-535396131550 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.875858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96535482-8f03-4452-b208-535396131550 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.876136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac1d1d-03e4-498d-b523-9683161b48d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de8007f03248b1ae1b7efb76862307, user_id=7f762359d36342598c933cede26ae953, role_id=cb22f0ef0c8a43869b3790774444735a)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.877992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96535482-8f03-4452-b208-535396131550 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.879841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 83/173] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:14.879947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac1d1d-03e4-498d-b523-9683161b48d1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.885359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96535482-8f03-4452-b208-535396131550 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:14.897208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96535482-8f03-4452-b208-535396131550 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:14.899470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 91/174] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:14 2022] PUT /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307/users/7f762359d36342598c933cede26ae953/roles/cb22f0ef0c8a43869b3790774444735a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:14.907676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaac40-bddf-4cea-843c-b40f64fa4dae None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.908083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaac40-bddf-4cea-843c-b40f64fa4dae None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.908235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaac40-bddf-4cea-843c-b40f64fa4dae None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.910343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 92/175] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:14.916070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.916352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.916624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.936896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:14.938159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:14.981542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:14.982166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:14.982509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:14.982791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:14.983663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] RBAC: Adding query filter params (role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=8784429d70b64e1da535a7547d9c0b2c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:14.983986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:14.988074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:14.994327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 84/176] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:14 2022] GET /identity/v3/role_assignments?user.id=8784429d70b64e1da535a7547d9c0b2c&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 608 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:15.008797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 93/177] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:15.036144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:15.046782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49709fa7-4f53-4ce3-9a01-6ccb252cd04c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:15.051682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f54e4-61c9-4eed-aeb1-2a03e1a7b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:15.052634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f54e4-61c9-4eed-aeb1-2a03e1a7b233 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:15.053026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f54e4-61c9-4eed-aeb1-2a03e1a7b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:15.053374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f54e4-61c9-4eed-aeb1-2a03e1a7b233 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:15.054866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f54e4-61c9-4eed-aeb1-2a03e1a7b233 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:15.056827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f54e4-61c9-4eed-aeb1-2a03e1a7b233 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:15.058981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 85/178] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:15.064919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:15.075045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea38e2-4fe1-45b1-add6-35077c3b200e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:15.079767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a03f9-97c1-4ef3-b72c-4e28d8caca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:15.080475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a03f9-97c1-4ef3-b72c-4e28d8caca96 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:15.080781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a03f9-97c1-4ef3-b72c-4e28d8caca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:15.081051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a03f9-97c1-4ef3-b72c-4e28d8caca96 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:15.081816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a03f9-97c1-4ef3-b72c-4e28d8caca96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:15.084036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a03f9-97c1-4ef3-b72c-4e28d8caca96 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:15.110174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 94/179] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:15 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:17.133002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ddad-b609-4e6d-86e2-e44ce8c795fb None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.133518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ddad-b609-4e6d-86e2-e44ce8c795fb None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.133518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ddad-b609-4e6d-86e2-e44ce8c795fb None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.135341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 86/180] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:17.140939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.141347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.141538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.159401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:17.160598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:17.168256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 95/181] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:17.192344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2ddad-b609-4e6d-86e2-e44ce8c795fb None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.205765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2ddad-b609-4e6d-86e2-e44ce8c795fb None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.210288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.211090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.211369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.211639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.222688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:17.229563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:17.231028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 87/182] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:17.237073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.246518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8da97-13a2-4277-b23b-e967ffaa2ee7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.251041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.251706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.251986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.252261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.253068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:17.253373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.255000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.263722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 96/183] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.269155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.278929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f962-cd24-4231-93f5-a4be59cc5b57 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.283416 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.284274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.284550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.284864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] PATH_INFO: `/v3/users/7f762359d36342598c933cede26ae953` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.286092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f762359d36342598c933cede26ae953)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.288250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.290075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 88/184] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/users/7f762359d36342598c933cede26ae953 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.295365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.305739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2ed77-978c-4dbd-8231-1ec4473c2183 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.310222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.310878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.311159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.311433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.320658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.322614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.334258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 97/185] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:17.339844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.351282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522e99-f6f6-4eb5-ad9c-91a2e88b1859 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.355997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48794ee2-89bc-471e-8df2-2d36a3e8e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.356923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48794ee2-89bc-471e-8df2-2d36a3e8e4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.357202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48794ee2-89bc-471e-8df2-2d36a3e8e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.357470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48794ee2-89bc-471e-8df2-2d36a3e8e4b5 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.358685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48794ee2-89bc-471e-8df2-2d36a3e8e4b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.360826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48794ee2-89bc-471e-8df2-2d36a3e8e4b5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.363350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 89/186] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.369216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.378319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5b809-dc26-41f9-b6fe-298b7b5d3706 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.382806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.383451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.383731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.384004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.384878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] RBAC: Adding query filter params (role.id=cb22f0ef0c8a43869b3790774444735a, scope.project.id=d2de8007f03248b1ae1b7efb76862307, user.id=7f762359d36342598c933cede26ae953) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:17.385186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.387046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09274b-250c-4d0e-80e0-cfd3df7d14cf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.393298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 98/187] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/role_assignments?user.id=7f762359d36342598c933cede26ae953&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=cb22f0ef0c8a43869b3790774444735a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.445085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3a8d-cec0-42b0-b2af-56e6ddd5b515 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.445421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3a8d-cec0-42b0-b2af-56e6ddd5b515 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.445641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3a8d-cec0-42b0-b2af-56e6ddd5b515 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.447487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 90/188] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:17.453713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.454016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.454255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.473380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:17.474585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:17.482361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 99/189] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:17.509320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a3a8d-cec0-42b0-b2af-56e6ddd5b515 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.524188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a3a8d-cec0-42b0-b2af-56e6ddd5b515 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.529207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.530115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.530387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.530655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.542956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:17.549965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:17.551430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 91/190] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:17.557428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.566901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2438db-8b86-4c0e-812c-cd788edb4593 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.571351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.572028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.572303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.572574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.573394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:17.573700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.575322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5db27d-3fe7-4098-a54a-dcdf4472feb0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.584411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 100/191] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.590048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.599892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7820c73-7071-4baa-8bb6-5444673aea08 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.604740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdf970-cbf6-4730-b796-29edc424935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.604996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbc40-9ef4-483e-bd2c-70c16c2b4387 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.605288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbc40-9ef4-483e-bd2c-70c16c2b4387 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.605385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf970-cbf6-4730-b796-29edc424935f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.605565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbc40-9ef4-483e-bd2c-70c16c2b4387 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.605664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf970-cbf6-4730-b796-29edc424935f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.605824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf970-cbf6-4730-b796-29edc424935f admin admin] PATH_INFO: `/v3/users/b4d499f1b2ad40338d364a6257cf9b80` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.607486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 101/192] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:17.608434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db089-cfbf-4819-859e-5c57e28a6083 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.608711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db089-cfbf-4819-859e-5c57e28a6083 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.609006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db089-cfbf-4819-859e-5c57e28a6083 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.611791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 102/193] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:17.615073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.615858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.616162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.621575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdf970-cbf6-4730-b796-29edc424935f admin admin] RBAC: Authorizing `identity:get_user(user_id=b4d499f1b2ad40338d364a6257cf9b80)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.623727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdf970-cbf6-4730-b796-29edc424935f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.625820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 92/194] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/users/b4d499f1b2ad40338d364a6257cf9b80 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:17.627057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.627337 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.627607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.635934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:17.636561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:17.645398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 103/195] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:17.649269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:17.649396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.649479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:17.657733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 93/196] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:17.659329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852a115-b784-42e9-a556-6da4eaf03bd9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.664318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.665018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.665295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.665561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.670137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.673841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.675639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.679549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f52a7-c744-4017-996d-f3ab2b479cf8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.683929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.684438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 104/197] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:17.684739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.685023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.685285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.686458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.688173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.689553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.689753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 94/198] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:17.690904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.699249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017410d2-7717-4137-8cad-ce64b5a80e7f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.700996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3900f4c-569d-4970-83a9-f325690300c2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.703846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.704631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.704957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.705224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.705369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.706155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.706431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.706701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.707847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.709872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.715909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 95/199] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:17.715909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.716103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:17.722462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:17.723603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 105/200] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:17.724338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.725663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e42abf-cf61-426c-b95a-afc38f414ac1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.730147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.730771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.731056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.731300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.732001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.733015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:17.733015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:44:17.733015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:44:17.733799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9e98-f37d-488f-b9ce-12a73dfe6c69 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.734204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.738470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.739068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.739348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.739619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.740440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=b4d499f1b2ad40338d364a6257cf9b80) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:17.740767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.742600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.748603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 106/201] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/role_assignments?user.id=b4d499f1b2ad40338d364a6257cf9b80&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.749711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.761259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b112bd-7336-42ab-b0d2-162b9816ba43 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.765970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.766682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.766937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.767208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.767651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 96/202] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:17 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:17.769666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:17.769812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.771581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.782156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 107/203] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.788088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.798632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88782bca-4cc7-4e6d-bf60-25c4f66e7156 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.803267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.804169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.804446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.804740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] PATH_INFO: `/v3/users/b4d499f1b2ad40338d364a6257cf9b80` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.806085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=b4d499f1b2ad40338d364a6257cf9b80)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.808327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.810410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 97/204] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/users/b4d499f1b2ad40338d364a6257cf9b80 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.816130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.826898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab042-1129-49f4-b04e-08ff225ed530 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.831965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.832676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.833018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.833292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.842643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.846170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.857239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 108/205] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:17.863427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.874195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59652b73-ccc7-471e-a713-de82d3ebddd3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.879196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42de92-2107-4441-b197-9388c4d6d0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.880108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42de92-2107-4441-b197-9388c4d6d0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.880367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42de92-2107-4441-b197-9388c4d6d0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.880629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42de92-2107-4441-b197-9388c4d6d0e3 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.881972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42de92-2107-4441-b197-9388c4d6d0e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.884101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42de92-2107-4441-b197-9388c4d6d0e3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.886219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 98/206] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:17.892380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:17.902081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a79f8-b79a-4ee3-a94c-983083704370 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:17.906825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:17.907511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:17.907789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:17.908059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:17.908951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] RBAC: Adding query filter params (role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=b4d499f1b2ad40338d364a6257cf9b80) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:17.909264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:17.911249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e9ec5-fbec-44cd-9c59-46d8a5693348 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:17.924763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 109/207] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:17 2022] GET /identity/v3/role_assignments?user.id=b4d499f1b2ad40338d364a6257cf9b80&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:19.932860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ffa2-4be6-4f64-a516-821217c899fc None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:19.933878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ffa2-4be6-4f64-a516-821217c899fc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:19.934353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ffa2-4be6-4f64-a516-821217c899fc None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:19.936371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 99/208] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:19.941880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:19.942302 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:19.942490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:19.960478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:19.961752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:19.969699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 110/209] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:19.993401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ffa2-4be6-4f64-a516-821217c899fc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.005790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ffa2-4be6-4f64-a516-821217c899fc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.010357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.011351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.011624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.011966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.022959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:20.030885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:20.032422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 100/210] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:20.038234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.047361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed894a1-5f0b-4198-8f15-86e2c0e733aa None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.051734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.052400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.052672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.052975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.053748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:20.054038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.055657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90849372-8438-41d1-ac34-8971ac4dc91d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.064589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 111/211] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.073044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.086196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb9491-b0a2-4b10-8097-d75b9c3b1081 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.090732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.091589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.091864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.092140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] PATH_INFO: `/v3/users/b4d499f1b2ad40338d364a6257cf9b80` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.092544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641a1d5-e57a-4797-9eac-10b3505b2a93 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.092873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641a1d5-e57a-4797-9eac-10b3505b2a93 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.093153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641a1d5-e57a-4797-9eac-10b3505b2a93 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.093547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] RBAC: Authorizing `identity:get_user(user_id=b4d499f1b2ad40338d364a6257cf9b80)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.094984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 112/212] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:20.095825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.097765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 101/213] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/users/b4d499f1b2ad40338d364a6257cf9b80 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.100393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882202b-99a9-41be-b723-9ce7cf5b86ad None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.100774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882202b-99a9-41be-b723-9ce7cf5b86ad None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.101123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882202b-99a9-41be-b723-9ce7cf5b86ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.103017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.113146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6498-76b5-4170-9b34-7fadd1560ecb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.117894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55046406-1e7f-4383-9129-b599eed2e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.118757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046406-1e7f-4383-9129-b599eed2e9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.119132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046406-1e7f-4383-9129-b599eed2e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.119405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046406-1e7f-4383-9129-b599eed2e9bc admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.119872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b882202b-99a9-41be-b723-9ce7cf5b86ad None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:20.120831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55046406-1e7f-4383-9129-b599eed2e9bc admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.121092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b882202b-99a9-41be-b723-9ce7cf5b86ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:20.122861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55046406-1e7f-4383-9129-b599eed2e9bc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.124750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 102/214] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:20.125984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d75b-b94e-4ff6-b31a-439a517b8660 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.126263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d75b-b94e-4ff6-b31a-439a517b8660 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.126527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d75b-b94e-4ff6-b31a-439a517b8660 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.128136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 103/215] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:20.128950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 113/216] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:20.129211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c01c8-8a2a-48cc-9eb2-3039ec31ac41 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.129475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c01c8-8a2a-48cc-9eb2-3039ec31ac41 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.129742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c01c8-8a2a-48cc-9eb2-3039ec31ac41 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.131401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 104/217] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:20.133970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.134342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.134677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.136113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.136388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.136656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.153961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:20.155110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:20.155388 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:20.156553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:20.162667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 105/218] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:20.163861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 114/219] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:20.164482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.165609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.173642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5485-0f77-4feb-8b7e-40a9cbe41973 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.176573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f60e43-a26e-465a-b311-9192d21e937f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.178128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.179103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.179380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.179660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/b4d499f1b2ad40338d364a6257cf9b80/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.181956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75afbd1f554f0fa2853845b593086c, user_id=b4d499f1b2ad40338d364a6257cf9b80, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.182613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.183695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.184159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.184610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.184815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.195788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:20.198791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 106/220] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:20 2022] PUT /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/b4d499f1b2ad40338d364a6257cf9b80/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:20.199578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.203108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:20.204492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 115/221] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:20.205161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.214918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bdf2-08fc-4933-a28a-35c66efdde97 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.266893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9b0c7-b50a-48f2-8716-46830f9d6d3f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.271416 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.272238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.272514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.272816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.273759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.274081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.274574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.274838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.275101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.275825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.277610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 107/222] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.278410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.288360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd99d7-be67-4f55-b448-ba693130dbfa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.292879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:20.293053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.293584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.293860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.294128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.294917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:20.295217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.296927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.301173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:20.302619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 116/223] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:20.303375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.305994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 108/224] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.311132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.313979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077a9e-c731-40c4-9166-1dabd49de2e8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.319376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.320057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.320333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.320598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.320980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12d72-4b92-4a7d-b99e-5832b380801c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.321374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.323309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.325260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.325946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.326216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.326488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.327273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:20.327568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.329279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.339317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 109/225] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.340274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.352342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c668e-f9a5-4c56-95dc-883127292ef2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.352544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 117/226] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:20 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:20.359745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.360840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.361322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.361675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] PATH_INFO: `/v3/users/b4d499f1b2ad40338d364a6257cf9b80` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.362835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.363606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] RBAC: Authorizing `identity:get_user(user_id=b4d499f1b2ad40338d364a6257cf9b80)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.366293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.368257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 110/227] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/users/b4d499f1b2ad40338d364a6257cf9b80 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.374510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.377368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998647bf-bbdc-4833-a7f9-aec38ca2050a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.383805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.384552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.384860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.385159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] PATH_INFO: `/v3/users/9c6afc808eec44f6850c2d8dd247d440` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.386565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b39f39-5be8-44ab-bf1c-9b0de6e28cfa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.396153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.397118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.397405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.397673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.399536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.401452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c6afc808eec44f6850c2d8dd247d440)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.401652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.403403 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 111/228] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.404213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.406204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 118/229] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/users/9c6afc808eec44f6850c2d8dd247d440 => generated 297 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.413481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.415364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.425458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861bd9-750d-45d8-b28d-a94b1aa14e62 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.426881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49808546-ec53-4024-979e-60943a88abb9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.430844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.431899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.432228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.432523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/b4d499f1b2ad40338d364a6257cf9b80/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.433613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.434680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.434927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75afbd1f554f0fa2853845b593086c, user_id=b4d499f1b2ad40338d364a6257cf9b80, role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.435386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.435865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.438221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.446171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.448265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.456846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 119/230] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:20 2022] PUT /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/b4d499f1b2ad40338d364a6257cf9b80/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:20.459321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 112/231] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:20.466953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.546010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811c8db-f799-434c-9c63-3ecc01352606 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.550549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1f36f-c432-4ae8-85e4-939c170172f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.551436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1f36f-c432-4ae8-85e4-939c170172f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.551711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1f36f-c432-4ae8-85e4-939c170172f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.551980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1f36f-c432-4ae8-85e4-939c170172f7 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.553366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1f36f-c432-4ae8-85e4-939c170172f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.555574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1f36f-c432-4ae8-85e4-939c170172f7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.557793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 120/232] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:20.564053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:20.574422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd2ee7-0cef-4d73-bbb0-341d2210744d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:20.580557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:20.581273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:20.581554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:20.581823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:20.582683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=9c6afc808eec44f6850c2d8dd247d440) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:20.582995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:20.584970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9c18a-ae5f-426d-a0c1-67d7426bcf2f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:20.591667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 113/233] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:20 2022] GET /identity/v3/role_assignments?user.id=9c6afc808eec44f6850c2d8dd247d440&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:22.727955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f683-428d-4333-879f-3211fd364170 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:22.728490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f683-428d-4333-879f-3211fd364170 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:22.728490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f683-428d-4333-879f-3211fd364170 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:22.730595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 121/234] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:22.736039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:22.736463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:22.736577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:22.761731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:22.762937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:22.770734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 114/235] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:22.808553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2f683-428d-4333-879f-3211fd364170 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:22.826847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2f683-428d-4333-879f-3211fd364170 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:22.834239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:22.835052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:22.835422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:22.835872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:22.851561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:22.858614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:22.860458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 122/236] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:22.866850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:22.876483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99257f-24a5-48e5-bdb4-ddda742605f7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:22.884650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:22.885376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:22.885651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:22.885928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:22.886714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:22.887011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:22.888655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:22.900168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 115/237] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:22.905697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:22.917799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3ea8-aafd-45d4-a3b9-b8eec2555c19 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:22.927936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:22.928845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:22.929129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:22.929406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] PATH_INFO: `/v3/users/b4d499f1b2ad40338d364a6257cf9b80` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:22.933452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=b4d499f1b2ad40338d364a6257cf9b80)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:22.935618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:22.937347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 123/238] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:22 2022] GET /identity/v3/users/b4d499f1b2ad40338d364a6257cf9b80 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:22.942851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:22.957977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60186-593f-4d45-bc0a-c5e147e07bcf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:22.968539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:22.969461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:22.969954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:22.970432 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:22.985219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:22.987579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:22.998364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 116/239] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:23.003858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.019723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77b34-e935-488c-9600-dfbb0fe88dd5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.029109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62be5-65df-429a-b90c-d90173c71ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.030047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62be5-65df-429a-b90c-d90173c71ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.030331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62be5-65df-429a-b90c-d90173c71ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.030605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62be5-65df-429a-b90c-d90173c71ae0 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.037920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62be5-65df-429a-b90c-d90173c71ae0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.040267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62be5-65df-429a-b90c-d90173c71ae0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.042686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 124/240] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.049039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.060484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261bc9a-b2d1-4e17-931b-6ed5deab732c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.069431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.069620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.069850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.070122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.070969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=b4d499f1b2ad40338d364a6257cf9b80) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:23.071268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.076746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82514f80-6997-4031-b93c-dbd1ac88d238 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.085577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 117/241] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/role_assignments?user.id=b4d499f1b2ad40338d364a6257cf9b80&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.270264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217745-d33c-4005-99e0-cdd8f477ffba None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.270918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217745-d33c-4005-99e0-cdd8f477ffba None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.271393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217745-d33c-4005-99e0-cdd8f477ffba None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.273825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 125/242] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:23.279301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d10f7a-f749-4200-9499-2d9287301e85 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.279598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d10f7a-f749-4200-9499-2d9287301e85 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.279850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d10f7a-f749-4200-9499-2d9287301e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.297530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373df6d-dd87-45ea-a5b7-b0783c701bbd None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.297836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373df6d-dd87-45ea-a5b7-b0783c701bbd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.298245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373df6d-dd87-45ea-a5b7-b0783c701bbd None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.300286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 126/243] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:23.305576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-73d10f7a-f749-4200-9499-2d9287301e85 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:23.307155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-73d10f7a-f749-4200-9499-2d9287301e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:23.308368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c589c5-b538-4ef7-966d-e30d1c8615ce None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.308655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c589c5-b538-4ef7-966d-e30d1c8615ce None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.308977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c589c5-b538-4ef7-966d-e30d1c8615ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.323431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 118/244] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:23.337394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-86c589c5-b538-4ef7-966d-e30d1c8615ce None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:23.338605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-86c589c5-b538-4ef7-966d-e30d1c8615ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:23.341589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1da0e-1a74-4abf-a32b-cd2df8e38baf None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.341869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1da0e-1a74-4abf-a32b-cd2df8e38baf None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.342140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1da0e-1a74-4abf-a32b-cd2df8e38baf None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.344192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 119/245] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:23.347763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1da0e-1a74-4abf-a32b-cd2df8e38baf None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.352657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 127/246] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:23.354379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bd359-ed1c-48ef-a2e7-f39a86ec1ce8 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.354666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bd359-ed1c-48ef-a2e7-f39a86ec1ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.354937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bd359-ed1c-48ef-a2e7-f39a86ec1ce8 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.356940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 128/247] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:23.357986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8558-5a0a-493f-a0b0-b8da47b4c903 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.358264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8558-5a0a-493f-a0b0-b8da47b4c903 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.358523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8558-5a0a-493f-a0b0-b8da47b4c903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.361466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1da0e-1a74-4abf-a32b-cd2df8e38baf None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.367524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.368317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.368591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.368921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.379704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d50c8558-5a0a-493f-a0b0-b8da47b4c903 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:23.381232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d50c8558-5a0a-493f-a0b0-b8da47b4c903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:23.385166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:23.391929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:23.393107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 129/248] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:23.393342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 120/249] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:23.394382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.394668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.394944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.397501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.408738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6112-f649-48cb-bd62-756ccc153064 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.412945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:23.413055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.413788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.414068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.414179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:23.414329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.415496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.417227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.418978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 121/250] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.419546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.427609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 130/251] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:23.428405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.430311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9288-dbc4-4442-90d4-171b11562d7c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.435191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.435847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.436130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.436392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.437242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:23.437577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.438866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d196-a362-40a3-8572-aec634f6a5be None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.439172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.443845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.444503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.444813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.445092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.445820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.447749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.454843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 122/252] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.455786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.465806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94afe7-4fc1-4e86-bea8-5c6664fedf95 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.470551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.471426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.471701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.471970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.479154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 131/253] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:23 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:23.479154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.483027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:23.489765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b84d21-a63c-4d1c-b273-2b9c83b12174 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.490636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:23.497044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 123/254] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:23.497044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.499672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.500955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.501357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.501618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.504864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad97ac-4dd4-42db-bf9a-94a1150f4cec admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.510474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.511462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.511740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.512008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] PATH_INFO: `/v3/users/9c6afc808eec44f6850c2d8dd247d440` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.515607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c6afc808eec44f6850c2d8dd247d440)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.515768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:23.517821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.519718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 124/255] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/users/9c6afc808eec44f6850c2d8dd247d440 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.520259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.528185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:23.529626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 132/256] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:23.530949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a56af-e07b-47b0-a0ae-73dd3646d4a7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.533797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.537195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.538133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.538559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.538963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.539874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:23.540371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.542188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.544940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428963d-1338-4d52-80f4-ea59bc2fd6c8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.549874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.550746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.551016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.551276 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.552266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 125/257] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.553333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.557360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.559546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.561403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 133/258] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.562187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.568966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dc762-0444-4e8d-893a-e9c24f5876c3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.572699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b695-ba94-4e54-a4cc-421711623a36 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.573712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.574501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.574781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.575053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.575825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:23.576225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.577514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.578048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.578431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.578706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.578968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] PATH_INFO: `/v3/users/355fe84f26bc4104842f50d8d3da33e3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.587117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 126/259] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.587946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.597697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb50bb-5e62-49a4-a217-86f36f8c918c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.599578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] RBAC: Authorizing `identity:get_user(user_id=355fe84f26bc4104842f50d8d3da33e3)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.601817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.602241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.603143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.603422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.603785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 134/260] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/users/355fe84f26bc4104842f50d8d3da33e3 => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.603881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/9c6afc808eec44f6850c2d8dd247d440/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.605562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.605774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75afbd1f554f0fa2853845b593086c, user_id=9c6afc808eec44f6850c2d8dd247d440, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.608847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.617501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d590610-5d38-4174-ad63-f53856fb985a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.632973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 127/261] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:23 2022] PUT /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/9c6afc808eec44f6850c2d8dd247d440/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:23.632973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.697392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.698275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.698554 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.698824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] PATH_INFO: `/v3/users/b4d499f1b2ad40338d364a6257cf9b80` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.700144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] RBAC: Authorizing `identity:get_user(user_id=b4d499f1b2ad40338d364a6257cf9b80)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.702392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.704438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 135/262] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/users/b4d499f1b2ad40338d364a6257cf9b80 => generated 283 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.710399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.713218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071dc7e-dab1-41af-ad1e-28138d22cf85 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.717809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.718525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.718831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.719075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.721007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa5a7-6e3f-4354-9770-daee9c109fef admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.725797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.726476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.726757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.727022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.730903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.732828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.737752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.739547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.744182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 128/263] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:23.749826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.751150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 136/264] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:44:23.756590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.759261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9be54-74f3-4724-8a3d-d1ed78969fb8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.764037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.765023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.765307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.765647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.766690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e99bd-1b2e-45ed-b7ba-2b767ae55c51 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.766969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.769299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.771118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 129/265] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:23.771475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.772442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.772793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.773035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.774285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.776781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.777227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.779053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 137/266] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:23.785775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:23.789956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d003cb-00a0-4481-9404-e3c086a5d81b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.794798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.795479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.795747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.796022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.796157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a16ff-f5af-4b0c-bcde-126d567a98e5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:23.796973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] RBAC: Adding query filter params (role.id=cb22f0ef0c8a43869b3790774444735a, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=355fe84f26bc4104842f50d8d3da33e3) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:23.797315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.799140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabba1-a280-46f9-a6ca-5be972bc87cf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.801018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:23.801778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:23.802102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:23.802373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:23.803252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] RBAC: Adding query filter params (role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=b4d499f1b2ad40338d364a6257cf9b80) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:23.803555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:23.806161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 130/267] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/role_assignments?user.id=355fe84f26bc4104842f50d8d3da33e3&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=cb22f0ef0c8a43869b3790774444735a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:23.806819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dce1c-dcda-496d-a220-93b4e0c67698 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:23.815253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 138/268] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:23 2022] GET /identity/v3/role_assignments?user.id=b4d499f1b2ad40338d364a6257cf9b80&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:25.856757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ea60-a691-4778-9e45-b636c2a4c1bd None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.857298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ea60-a691-4778-9e45-b636c2a4c1bd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.857298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ea60-a691-4778-9e45-b636c2a4c1bd None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.859578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 131/269] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:25.865958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac8a6-b1b1-4be9-a2b1-3f4c6e22cf41 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.866597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac8a6-b1b1-4be9-a2b1-3f4c6e22cf41 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.866597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac8a6-b1b1-4be9-a2b1-3f4c6e22cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.885073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2d0ac8a6-b1b1-4be9-a2b1-3f4c6e22cf41 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:25.886257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2d0ac8a6-b1b1-4be9-a2b1-3f4c6e22cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:25.893842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 139/270] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:25.908072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e907-eb0d-4c41-b311-6ea09cfa41d7 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.908352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e907-eb0d-4c41-b311-6ea09cfa41d7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.908623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e907-eb0d-4c41-b311-6ea09cfa41d7 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.910593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 132/271] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:25.917663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e907-eb0d-4c41-b311-6ea09cfa41d7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:25.917832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.918121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.918391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.930500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e907-eb0d-4c41-b311-6ea09cfa41d7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:25.940091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:25.940091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:25.940442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:25.940442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.940442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.940442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.947240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 140/272] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:25.952431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:25.959736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:25.961229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 133/273] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:25.970111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:25.970912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:25.979819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fc7fd-0705-4ab3-b59c-e1f112599c2d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:25.981260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc985-2806-4ac6-a6c3-2e8acad3fa44 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:25.984225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:25.984919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.985194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.985461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.986061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:25.986215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:25.986517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:25.987464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:25.987820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:25.988211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:25.988480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:25.999111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:26.000831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 141/274] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.003180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.006501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:26.008047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 134/275] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:26.013023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198ecfc-5fdd-47f6-b56c-fe1e788eadb7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.013669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.017528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.018386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.018662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.018930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] PATH_INFO: `/v3/users/9c6afc808eec44f6850c2d8dd247d440` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.020126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c6afc808eec44f6850c2d8dd247d440)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.022293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.024021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3d90-64da-4a4d-8edc-64ac17196afb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.028314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 142/276] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/users/9c6afc808eec44f6850c2d8dd247d440 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:26.029685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.032701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.033621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.034189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.034649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.035602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:26.036104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.037920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.039501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c914e-af82-4310-a80e-1b785302fc98 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.043804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.044429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.044703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.045007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.048315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 135/277] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:26.053580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.054170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.055465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.063992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7777-cd45-4e76-917b-6489ac0ffb9d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.064614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 143/278] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:44:26.070190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.075202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095149d-83bc-4a99-bd08-02d325c97751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.076310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095149d-83bc-4a99-bd08-02d325c97751 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.076832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095149d-83bc-4a99-bd08-02d325c97751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.077316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095149d-83bc-4a99-bd08-02d325c97751 admin admin] PATH_INFO: `/v3/users/85c5afdd03a0478492680e2623ee2c27` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.079019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a7f94-9065-4617-aabc-0e6f85e3e875 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.088194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc88513-f78b-4703-9b0a-f2f8d138f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.089098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc88513-f78b-4703-9b0a-f2f8d138f2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.089380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc88513-f78b-4703-9b0a-f2f8d138f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.089659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc88513-f78b-4703-9b0a-f2f8d138f2c9 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.090865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc88513-f78b-4703-9b0a-f2f8d138f2c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.092782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095149d-83bc-4a99-bd08-02d325c97751 admin admin] RBAC: Authorizing `identity:get_user(user_id=85c5afdd03a0478492680e2623ee2c27)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.092968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc88513-f78b-4703-9b0a-f2f8d138f2c9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.094857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 144/279] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:26.095883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dcf45-48b8-4aef-b4b2-b6851e78cdd4 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.096178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dcf45-48b8-4aef-b4b2-b6851e78cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.096453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dcf45-48b8-4aef-b4b2-b6851e78cdd4 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.098409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 145/280] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:26.098540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095149d-83bc-4a99-bd08-02d325c97751 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.100638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 136/281] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/users/85c5afdd03a0478492680e2623ee2c27 => generated 293 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:26.101307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dcf45-48b8-4aef-b4b2-b6851e78cdd4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.103339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.103794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.104253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.117075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dcf45-48b8-4aef-b4b2-b6851e78cdd4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.121283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.121925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.122201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.122438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:26.122530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.123304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=9c6afc808eec44f6850c2d8dd247d440) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:26.123612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.123696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:26.125586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34550d-2cd4-4116-9a9b-0a27dc1f91d4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.131436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 137/282] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:26.132016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.132860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 146/283] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/role_assignments?user.id=9c6afc808eec44f6850c2d8dd247d440&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.134411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be9ac7-7bcc-4bd8-a564-b396da6b1c27 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.134898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be9ac7-7bcc-4bd8-a564-b396da6b1c27 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.135398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be9ac7-7bcc-4bd8-a564-b396da6b1c27 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.137355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 147/284] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:26.143070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.143341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.143611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.147540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9d778-ff07-41c9-8c38-cd6814716e42 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.153953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.155173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.155453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.155721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.156672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, user.id=85c5afdd03a0478492680e2623ee2c27, scope.system=all) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:26.157004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.159926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.163461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:26.164805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:26.169191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 138/285] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/role_assignments?user.id=85c5afdd03a0478492680e2623ee2c27&scope.system=all&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.170223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.177064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 148/286] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:26.183055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da543-27f7-40b0-8a82-8f1f02e894bf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.188367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.189611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.190097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.190533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.192180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.194368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.196626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 139/287] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.197115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.202611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.209156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c16b7-ca43-4953-ac49-a86954c5dc06 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.214446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1988-55ea-4b6d-b7fc-5159ecd84609 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.216003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.217126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.217504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.217887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.220998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.221915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.222346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.222753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.223687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.225903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.232352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:26.240156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:26.244802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 149/288] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:26.248357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.255894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 140/289] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:26 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:26.268777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7a26f-04bc-4b3f-b144-84f04386d29b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.271625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.272326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.272606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.272914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.273800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:26.274104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.276010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.287735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 150/290] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.295436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.307910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820359c2-404e-47a7-bcfa-e3c05b7fccfc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.313991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.315932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.317009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.317818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] PATH_INFO: `/v3/users/355fe84f26bc4104842f50d8d3da33e3` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.319560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=355fe84f26bc4104842f50d8d3da33e3)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.322364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.325000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 141/291] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/users/355fe84f26bc4104842f50d8d3da33e3 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.332764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.345577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf212d-3958-4f76-b53a-0a957e91668d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.356546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8bb71-da84-4403-aafa-5e40f9575be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.357824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8bb71-da84-4403-aafa-5e40f9575be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.358327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8bb71-da84-4403-aafa-5e40f9575be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.358864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8bb71-da84-4403-aafa-5e40f9575be6 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.360589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8bb71-da84-4403-aafa-5e40f9575be6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.364680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8bb71-da84-4403-aafa-5e40f9575be6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.368601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 151/292] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:26 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:26.375385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:26.386371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c7ee-adbd-4d17-8d67-6b87930466a4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:26.391301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aba95-9967-40a1-8949-dbdfcc6bbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:26.392424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aba95-9967-40a1-8949-dbdfcc6bbca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:26.392880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aba95-9967-40a1-8949-dbdfcc6bbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:26.393284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aba95-9967-40a1-8949-dbdfcc6bbca5 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/355fe84f26bc4104842f50d8d3da33e3/roles/cb22f0ef0c8a43869b3790774444735a` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:26.395586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aba95-9967-40a1-8949-dbdfcc6bbca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75afbd1f554f0fa2853845b593086c, user_id=355fe84f26bc4104842f50d8d3da33e3, role_id=cb22f0ef0c8a43869b3790774444735a)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:26.398476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aba95-9967-40a1-8949-dbdfcc6bbca5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:26.413997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 142/293] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:26 2022] PUT /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c/users/355fe84f26bc4104842f50d8d3da33e3/roles/cb22f0ef0c8a43869b3790774444735a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:28.411492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97855e-1843-4440-98ef-55be49ac6e39 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.412022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97855e-1843-4440-98ef-55be49ac6e39 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.412022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97855e-1843-4440-98ef-55be49ac6e39 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.414093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 152/294] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:28.419445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.420259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.420760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.439257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:28.440438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:28.497859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 143/295] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:28.520351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97855e-1843-4440-98ef-55be49ac6e39 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.534061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97855e-1843-4440-98ef-55be49ac6e39 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.538316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.539103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.539374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.539640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.550140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:28.556830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:28.558336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 153/296] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:28.564083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.573207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978d29-3b46-4d29-a069-fa07898379a9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.577613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.578339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.578668 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.578937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.579748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:28.580047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.581720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9017d-4a6c-408f-80c8-a1d5a57aa4bf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.590530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 144/297] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:28.595938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.606157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b3f8-2e30-4125-acd7-046256472731 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.606436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b3f8-2e30-4125-acd7-046256472731 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.606713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b3f8-2e30-4125-acd7-046256472731 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.606815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24343528-6f70-4bb0-aa17-473fea0efa18 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.608755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 145/298] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:28.618338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35acd-a50c-4cf4-b245-b6e4b247b2a1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.618632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35acd-a50c-4cf4-b245-b6e4b247b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.618908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35acd-a50c-4cf4-b245-b6e4b247b2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.619631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.620744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.621355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.621886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] PATH_INFO: `/v3/users/85c5afdd03a0478492680e2623ee2c27` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.623379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] RBAC: Authorizing `identity:get_user(user_id=85c5afdd03a0478492680e2623ee2c27)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.625959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.634229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 154/299] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/users/85c5afdd03a0478492680e2623ee2c27 => generated 293 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:28.635697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.639497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-50d35acd-a50c-4cf4-b245-b6e4b247b2a1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:28.640836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-50d35acd-a50c-4cf4-b245-b6e4b247b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:28.646164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8d7e-15b2-42af-9b1e-105935e29f81 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.648240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 146/300] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:28.649643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c594d4-2065-4bd8-bc94-91ada6b0f53e None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.649929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c594d4-2065-4bd8-bc94-91ada6b0f53e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.650195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c594d4-2065-4bd8-bc94-91ada6b0f53e None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.651650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.651856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 147/301] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:28.652749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.653350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75a78-353b-40c4-a01f-6c08caa09c8b None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.653452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.653524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75a78-353b-40c4-a01f-6c08caa09c8b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.653590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] PATH_INFO: `/v3/system/users/85c5afdd03a0478492680e2623ee2c27/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.653673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75a78-353b-40c4-a01f-6c08caa09c8b None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.654786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85c5afdd03a0478492680e2623ee2c27, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.655422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 148/302] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:28.657553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:28.657553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:28.657553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:28.658430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879fc9f-c2ea-4a51-b7ae-0f4508588c3c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.659043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.659448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.659856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.669374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 155/303] 10.222.0.31 () {58 vars in 1355 bytes} [Thu Feb 3 02:44:28 2022] PUT /identity/v3/system/users/85c5afdd03a0478492680e2623ee2c27/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:28.670766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.671055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.671322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.680262 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:28.681563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:28.694926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 149/304] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:28.694926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.697712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:28.698982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:28.703884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9bdcf-0753-4c77-88c9-d80804173b06 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.708852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.709683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.709958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.710227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.710515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 156/305] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:28.714752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.721649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:28.725845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b060ddf-d509-4b4f-83f0-9125cc9f94e8 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.729838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:28.730950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.736072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 150/306] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:28.736072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.736341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.736341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.736341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.746023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ce0f7-9637-405b-8b45-1618d7f5f5da admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.748063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:28.750494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.751309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.751588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.751859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.753139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.754873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.755132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:28.756578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 157/307] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:28.756784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 151/308] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:28.761607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.762594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.773488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491da207-aa40-404f-9608-bfe521c2c161 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.773735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375c332-5f8e-4c4f-97d6-17d9fc5370f3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.778089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.778243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.778762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.778860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.779030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.779120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.779301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.779391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] PATH_INFO: `/v3/groups` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.780011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.780107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:28.780365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.781134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:28.781134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:44:28.781134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:44:28.782173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.782343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.792626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 158/309] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:28.793389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.803013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 152/310] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 3 02:44:28 2022] POST /identity/v3/groups => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:28.804331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.813872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb742af-bafa-486a-bbb8-4d0bd7564ebd admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.815598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f88c18-d04b-42ac-8e2b-900b1d39c7e0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.820562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.820993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.821721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.822005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.822327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.822813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.823155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:28.823452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.823748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.824215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] PATH_INFO: `/v3/users/adfc2d44984e4541ab3f25c3283a6e63` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.825405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.841382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] RBAC: Authorizing `identity:get_user(user_id=adfc2d44984e4541ab3f25c3283a6e63)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.842183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 159/311] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:28.846984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.848477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.849865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 153/312] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/users/adfc2d44984e4541ab3f25c3283a6e63 => generated 293 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:28.855677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.861666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bb9cc-46c7-4029-8003-e771fd55c77c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.869178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.869463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea7e4-b663-4eb7-89d9-a805db37a138 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.870657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.871100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.871436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] PATH_INFO: `/v3/users/355fe84f26bc4104842f50d8d3da33e3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.873775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] RBAC: Authorizing `identity:get_user(user_id=355fe84f26bc4104842f50d8d3da33e3)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.874004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.874719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.874994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.875263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.876112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] RBAC: Adding query filter params (role.id=cb22f0ef0c8a43869b3790774444735a, user.id=adfc2d44984e4541ab3f25c3283a6e63, scope.system=all) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:28.876415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.877143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.878490 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.884225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 160/313] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/users/355fe84f26bc4104842f50d8d3da33e3 => generated 297 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:28.886433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.891113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 154/314] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/role_assignments?user.id=adfc2d44984e4541ab3f25c3283a6e63&scope.system=all&role.id=cb22f0ef0c8a43869b3790774444735a => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:28.897965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53588d59-2dd6-4c09-a1da-2fe330713c0b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.902789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.903588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.903932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.904270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.914252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.916208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.927232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 161/315] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:28.933250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.944233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08194ef-a81c-4311-a7ba-f80883649b76 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.949239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2415-c312-4964-86e6-cd6902e6710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.950408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2415-c312-4964-86e6-cd6902e6710d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.950962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2415-c312-4964-86e6-cd6902e6710d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.951406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2415-c312-4964-86e6-cd6902e6710d admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.953088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2415-c312-4964-86e6-cd6902e6710d admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.955496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2415-c312-4964-86e6-cd6902e6710d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.957648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 155/316] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:28.964219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:28.974189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d56b-c4fd-40e3-ae77-f409472b1fb1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:28.979142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:28.980090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:28.980537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:28.980980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:28.981990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] RBAC: Adding query filter params (role.id=cb22f0ef0c8a43869b3790774444735a, scope.project.id=3e75afbd1f554f0fa2853845b593086c, user.id=355fe84f26bc4104842f50d8d3da33e3) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:28.982453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:28.984576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574450-aa03-4176-afc4-a3d2a209cf4d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:28.992050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 162/317] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:28 2022] GET /identity/v3/role_assignments?user.id=355fe84f26bc4104842f50d8d3da33e3&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=cb22f0ef0c8a43869b3790774444735a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:30.897379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bd8c2-a0e3-494f-9aca-f961b3b3fc28 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:30.897906 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bd8c2-a0e3-494f-9aca-f961b3b3fc28 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:30.898198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bd8c2-a0e3-494f-9aca-f961b3b3fc28 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:30.899962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 156/318] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:30.905375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:30.905752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:30.905954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:30.924449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:30.925662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:30.933977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 163/319] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:30.956872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bd8c2-a0e3-494f-9aca-f961b3b3fc28 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:30.969504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bd8c2-a0e3-494f-9aca-f961b3b3fc28 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:30.973997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:30.974790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:30.975068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:30.975335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:30.986301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:30.993431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:30.994791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 157/320] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:31.000462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.009616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294e06-992e-451b-ac76-0d4588605725 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.014483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.015169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.015638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.015892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.016752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:31.017058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.018676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.027298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 164/321] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:31.032637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.043091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7685-ee63-49b4-90a0-b126142e7d63 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.047937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf39e55-c2fd-4a7d-aa61-dba35b87ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.048825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39e55-c2fd-4a7d-aa61-dba35b87ba88 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.049076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39e55-c2fd-4a7d-aa61-dba35b87ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.049374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39e55-c2fd-4a7d-aa61-dba35b87ba88 admin admin] PATH_INFO: `/v3/users/85c5afdd03a0478492680e2623ee2c27` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.050593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf39e55-c2fd-4a7d-aa61-dba35b87ba88 admin admin] RBAC: Authorizing `identity:get_user(user_id=85c5afdd03a0478492680e2623ee2c27)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.052746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf39e55-c2fd-4a7d-aa61-dba35b87ba88 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.054528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 158/322] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:31 2022] GET /identity/v3/users/85c5afdd03a0478492680e2623ee2c27 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:31.060044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.073961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f35e-f165-4e39-88c9-ba924c86fd1d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.078450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109b40-e9e0-4384-a40b-1055ab66b33a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.078728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109b40-e9e0-4384-a40b-1055ab66b33a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.079001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109b40-e9e0-4384-a40b-1055ab66b33a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.079135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.079652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.079932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.080201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.080907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 159/323] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:31.081071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] RBAC: Adding query filter params (role.id=4e7921a08ea049ac85d7f219cc8c8fc7, user.id=85c5afdd03a0478492680e2623ee2c27, scope.system=all) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:31.081376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.081850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf08117-73c2-48c2-b11d-d1279d734fba None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.082119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf08117-73c2-48c2-b11d-d1279d734fba None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.082394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf08117-73c2-48c2-b11d-d1279d734fba None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.083231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ffa7-9013-49b0-a265-4a2b8b8a5713 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.084145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 160/324] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:31.086886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.087158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.087427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.104187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 165/325] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 3 02:44:31 2022] GET /identity/v3/role_assignments?user.id=85c5afdd03a0478492680e2623ee2c27&scope.system=all&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 510 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:31.105570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.105863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.106015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:31.106126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.107278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:31.117115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 161/326] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:31.125262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:31.126484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:31.134929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 166/327] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:31.139855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.149843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f4bbd-7fde-43f6-a87c-88cc617b992e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.154685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.155494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.155746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.156124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.157900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.167698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644e15e-c06a-4e74-a53b-eb5764a64a1b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.168669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:31.172695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.173548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.173817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.174079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.175289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.175667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:31.177141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 162/328] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:31.177256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.178851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 167/329] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:31.183513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.184067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.193573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1b32-8261-4fb9-b102-7da815746d06 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.194080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af343d-e3b6-417f-9d7e-b0bddd20da38 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.198014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.198712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.198957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.199052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.199228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.199723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.200004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.200092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:31.200283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] PATH_INFO: `/v3/groups` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.200372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.201044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.201932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.202098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:31.202098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:31.202098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:31.203258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.212670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 163/330] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:31.219089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.224775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 168/331] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 3 02:44:31 2022] POST /identity/v3/groups => generated 226 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:31.239153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db2d9e-89d5-423c-9ed8-609c10211d89 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.244234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d196a0-e6f1-4434-85cb-a2af7469936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.245284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d196a0-e6f1-4434-85cb-a2af7469936b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.245625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d196a0-e6f1-4434-85cb-a2af7469936b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.245963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d196a0-e6f1-4434-85cb-a2af7469936b admin admin] PATH_INFO: `/v3/users/adfc2d44984e4541ab3f25c3283a6e63` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.247529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d196a0-e6f1-4434-85cb-a2af7469936b admin admin] RBAC: Authorizing `identity:get_user(user_id=adfc2d44984e4541ab3f25c3283a6e63)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.250028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d196a0-e6f1-4434-85cb-a2af7469936b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.251901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 164/332] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:31 2022] GET /identity/v3/users/adfc2d44984e4541ab3f25c3283a6e63 => generated 293 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:31.258216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:31.268905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ca41-4eb6-4dfb-aec7-249d11064cae admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:31.273541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e813c-35cc-47a0-a6e2-060fac11a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:31.274527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e813c-35cc-47a0-a6e2-060fac11a64b admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:31.274878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e813c-35cc-47a0-a6e2-060fac11a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:31.275230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e813c-35cc-47a0-a6e2-060fac11a64b admin admin] PATH_INFO: `/v3/system/users/adfc2d44984e4541ab3f25c3283a6e63/roles/cb22f0ef0c8a43869b3790774444735a` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:31.276888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e813c-35cc-47a0-a6e2-060fac11a64b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=adfc2d44984e4541ab3f25c3283a6e63, role_id=cb22f0ef0c8a43869b3790774444735a)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:31.278574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e813c-35cc-47a0-a6e2-060fac11a64b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:31.289222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 169/333] 10.222.0.31 () {58 vars in 1355 bytes} [Thu Feb 3 02:44:31 2022] PUT /identity/v3/system/users/adfc2d44984e4541ab3f25c3283a6e63/roles/cb22f0ef0c8a43869b3790774444735a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:33.604284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721a501-fadf-414d-82c3-a38d09c25564 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:33.604822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721a501-fadf-414d-82c3-a38d09c25564 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:33.604822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721a501-fadf-414d-82c3-a38d09c25564 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:33.606870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 165/334] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:33.612818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:33.613226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:33.613386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:33.632788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:33.634300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:33.648823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 170/335] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:33.667277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721a501-fadf-414d-82c3-a38d09c25564 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:33.680392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721a501-fadf-414d-82c3-a38d09c25564 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:33.685109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:33.685898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:33.686170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:33.686434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:33.696880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:33.703616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 03 02:44:33.708866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 166/336] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:33.710966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:33.720268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afec26-535e-4620-bab3-68e7aeebae55 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:33.725828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:33.726501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:33.726776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:33.727043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:33.727804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:33.728101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:33.729764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:33.743491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 171/337] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:33.744873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:33.754678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36b0b-aab7-4959-abe5-eaef04aaa3ca admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:33.759268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd720a02-28c4-40b7-8e1b-a7961109bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:33.760125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd720a02-28c4-40b7-8e1b-a7961109bdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:33.760398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd720a02-28c4-40b7-8e1b-a7961109bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:33.760671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd720a02-28c4-40b7-8e1b-a7961109bdc6 admin admin] PATH_INFO: `/v3/users/adfc2d44984e4541ab3f25c3283a6e63` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:33.761890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd720a02-28c4-40b7-8e1b-a7961109bdc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=adfc2d44984e4541ab3f25c3283a6e63)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:33.763995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd720a02-28c4-40b7-8e1b-a7961109bdc6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:33.765904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 167/338] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:44:33 2022] GET /identity/v3/users/adfc2d44984e4541ab3f25c3283a6e63 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:33.772816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:33.782717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0be4-b07b-4d57-baf2-e98d256ceb59 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:33.787112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:33.787763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:33.788035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:33.788309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:33.789175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] RBAC: Adding query filter params (role.id=cb22f0ef0c8a43869b3790774444735a, user.id=adfc2d44984e4541ab3f25c3283a6e63, scope.system=all) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:33.789478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:33.791347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4f4c5-e31f-45ac-a414-f13f35fc9594 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:33.805907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 172/339] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 3 02:44:33 2022] GET /identity/v3/role_assignments?user.id=adfc2d44984e4541ab3f25c3283a6e63&scope.system=all&role.id=cb22f0ef0c8a43869b3790774444735a => generated 510 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.436664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce6816-c70d-4156-9eb3-03439d472c3f None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.437156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce6816-c70d-4156-9eb3-03439d472c3f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.437383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce6816-c70d-4156-9eb3-03439d472c3f None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.439466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 168/340] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:34.444642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f9a1-d587-4137-bb2f-3e23769093aa None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.445272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f9a1-d587-4137-bb2f-3e23769093aa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.445758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f9a1-d587-4137-bb2f-3e23769093aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.469780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4403f9a1-d587-4137-bb2f-3e23769093aa None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:34.471340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4403f9a1-d587-4137-bb2f-3e23769093aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:34.484654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 173/341] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:34.509013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6958f9f-d984-42c0-8fad-fe21150d8909 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.509345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6958f9f-d984-42c0-8fad-fe21150d8909 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.509558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6958f9f-d984-42c0-8fad-fe21150d8909 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.511607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 169/342] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:34.516948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.517485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.517967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.520635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6958f9f-d984-42c0-8fad-fe21150d8909 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.539103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6958f9f-d984-42c0-8fad-fe21150d8909 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.539834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:34.541046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:34.543698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dca6a1-6389-4166-abcc-823a6844e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.544662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca6a1-6389-4166-abcc-823a6844e69e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.544959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca6a1-6389-4166-abcc-823a6844e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.545227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca6a1-6389-4166-abcc-823a6844e69e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.549314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 174/343] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:34.567608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dca6a1-6389-4166-abcc-823a6844e69e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:34.576333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.581069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-50dca6a1-6389-4166-abcc-823a6844e69e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:34.582966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 170/344] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:34.587039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f433fae-baeb-41a5-9f5b-029d61a9d53d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.589761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3e8d1-d7a2-4d9e-914e-a4b1bcea724c None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.590044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3e8d1-d7a2-4d9e-914e-a4b1bcea724c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.590311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3e8d1-d7a2-4d9e-914e-a4b1bcea724c None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.592182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 171/345] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:34.592834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3e8d1-d7a2-4d9e-914e-a4b1bcea724c None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.595843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea00800-20bf-40ca-af6b-cea68c506b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.596894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00800-20bf-40ca-af6b-cea68c506b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.597342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00800-20bf-40ca-af6b-cea68c506b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.597798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00800-20bf-40ca-af6b-cea68c506b90 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.611123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea00800-20bf-40ca-af6b-cea68c506b90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:34.611954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3e8d1-d7a2-4d9e-914e-a4b1bcea724c None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.619832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-7ea00800-20bf-40ca-af6b-cea68c506b90 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:34.620294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.620985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.621259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.621527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.622293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:34.622462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 175/346] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:34.622659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.624075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.624335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.628972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.628972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.641067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 172/347] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.642148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.649436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:34.650529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:34.653275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f30b7a-be7e-4c50-82f9-e974263c830d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.658530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.658662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 176/348] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:34.659499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.659946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.660391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.661406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:34.661508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.662082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.663834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.673314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 173/349] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.679645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.682852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccb1f-c0d2-4f55-9fe8-f3162d897e7f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.688745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.689394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.689677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.689958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.695015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812d0a-4afd-4582-871f-24b5bc4598b3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.698571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.700462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.709252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.709914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.710180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.710447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.719322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 177/350] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:34.720156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.721801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.723958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.731788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e0448-8470-4590-be09-aaf7d64b124d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.736112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 174/351] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:34.737544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.741098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.741947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.742225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.742494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.748105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ece7-1434-4b56-bda4-bff045a5648d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.756653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.758086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.758191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:34.758650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.759106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.760475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.763351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.765652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 175/352] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.766057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:34.767058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.767333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 178/353] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:34.772849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.777692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80fdc-d9fe-4df8-8936-f0c9323218f0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.784126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.784427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f32f-bcaa-4ba3-83d8-58f781282547 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.785436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.785969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.786462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.788088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.789505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.792170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.792170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.792170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.792798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.798422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 176/354] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.800054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.801485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.802716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:34.802716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:34.802716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:34.804204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.808384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 179/355] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.813860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.814558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cbe1f-da32-46ea-a270-ed3e518079db admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.821918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.822669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.822950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.823225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.824142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:34.824405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.826211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.828509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4aa0-a701-4317-9a46-c97b387baf04 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.834634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.835566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.835981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.836241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 177/356] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.836605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.837147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.837920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=d2de8007f03248b1ae1b7efb76862307) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:34.838533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.840566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.849208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aebed-def3-4f95-87ea-12a32212c8a8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.849396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 180/357] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.850307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.856082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.857333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.857832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.858295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.859920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.861227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:34.861227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:44:34.861227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:44:34.863130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.870931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 178/358] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.872742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.878264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e66e-7a7d-4d7c-9d88-44a62bbe05e4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.883986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744e14-ce9b-45f2-8656-9be5d68b5c5f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.888832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.889343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.889553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.889836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.890207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.891003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.891466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.891922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.893017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=d2de8007f03248b1ae1b7efb76862307) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:34.893549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.895999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.907025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 179/359] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:34.912356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.914332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.939122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 181/360] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:34.944519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.956608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e50ba1-357c-47af-a913-eb82b7c84c84 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:34.968744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:34.970280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:34.970766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:34.971042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:34.972284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:34.974428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:34.980553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 180/361] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:34.981900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:34.998543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38a29d-f4dd-41b4-85a8-291f366ea2a6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.011098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542493f-fbec-4aeb-a315-b5a6cb71d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.011989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542493f-fbec-4aeb-a315-b5a6cb71d6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.012267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542493f-fbec-4aeb-a315-b5a6cb71d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.012547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542493f-fbec-4aeb-a315-b5a6cb71d6a1 admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.017431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542493f-fbec-4aeb-a315-b5a6cb71d6a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.019394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542493f-fbec-4aeb-a315-b5a6cb71d6a1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.021257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 182/362] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:34 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.027559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.038340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0024081-8559-4d5d-bf61-6876a25eb682 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.049162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.049840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.050112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.050377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.051227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=3e75afbd1f554f0fa2853845b593086c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:35.051532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.053459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4a53-70c0-4fdd-8833-35c41a40303b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.060047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 181/363] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.149439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364a34-b8a7-4408-b5c2-e54c057417c6 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.149787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364a34-b8a7-4408-b5c2-e54c057417c6 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.150008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364a34-b8a7-4408-b5c2-e54c057417c6 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.152234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 183/364] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:35.158204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.158541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.158748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.181399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:35.182966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:35.199371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 182/365] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:35.227787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4364a34-b8a7-4408-b5c2-e54c057417c6 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.241099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4364a34-b8a7-4408-b5c2-e54c057417c6 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.245467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.246289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.246569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.246834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.259382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:35.275297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:35.276967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 184/366] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:35.283449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.292568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0b753-333f-4b7a-b36f-3a0fb4104f19 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.300762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.301449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.301728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.301990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.302761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:35.303058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.304651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.314757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 183/367] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.319919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.337577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9d64-73ac-469e-83e9-3398b9880428 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.342272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.342959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.343243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.343512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.353789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.355596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.370956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 185/368] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:35.376414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.389047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496dca-a0d9-4ce3-a41b-1ebfcaa34593 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.399902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.400789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.401066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.401358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.402523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.404561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.406542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 184/369] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.411953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.421235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9d47-2f49-4770-9d17-70a9ef8eac26 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.427841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6bc5d-c66e-4b70-8574-6aa9ff165d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.429055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bc5d-c66e-4b70-8574-6aa9ff165d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.429578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bc5d-c66e-4b70-8574-6aa9ff165d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.430060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bc5d-c66e-4b70-8574-6aa9ff165d2a admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.431538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6bc5d-c66e-4b70-8574-6aa9ff165d2a admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.438019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6bc5d-c66e-4b70-8574-6aa9ff165d2a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.440274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 186/370] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.445992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.459575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7c54b-a537-4413-bc15-5ad2ad94ea0b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.465483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.466123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.466398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.466660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.467503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=3e75afbd1f554f0fa2853845b593086c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:35.467808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.469729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9346-c03f-4d0a-be70-6eb1253f845d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.476405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 185/371] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.775342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505aa14-e1cc-4cb9-8cb8-ff35c0a6f5e6 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.775841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505aa14-e1cc-4cb9-8cb8-ff35c0a6f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.775841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505aa14-e1cc-4cb9-8cb8-ff35c0a6f5e6 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.777934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 187/372] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:35.783609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.784062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.784136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.808841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:35.810410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:35.819418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 186/373] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:35.844944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505aa14-e1cc-4cb9-8cb8-ff35c0a6f5e6 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.859629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505aa14-e1cc-4cb9-8cb8-ff35c0a6f5e6 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.865306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.866184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.866463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.866735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.878286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:35.885043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:35.888386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 188/374] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:35.894225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.903952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455e9d3-2f54-4897-9927-308fd67214e7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.913336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.914313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.914808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.915277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.916319 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:35.916858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.918792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.934896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 187/375] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:35.940837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:35.957772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5c2cf-8afe-43b4-9cf5-d04473c7b38a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:35.966921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:35.967588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:35.967881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:35.968168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:35.979630 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:35.981854 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:35.996777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 189/376] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:36.002830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:36.013299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63277b-0d10-4583-8f8b-1c06db23efbe admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:36.020360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:36.021631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:36.022130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:36.022617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:36.024123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:36.026297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:36.028561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 188/377] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:36 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:36.033871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:36.045014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfded91d-9850-4075-af27-d81887fa6921 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:36.050845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce00f-2434-4267-a7f5-cb0566cbb9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:36.052003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce00f-2434-4267-a7f5-cb0566cbb9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:36.052557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce00f-2434-4267-a7f5-cb0566cbb9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:36.053095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce00f-2434-4267-a7f5-cb0566cbb9fd admin admin] PATH_INFO: `/v3/groups/c59cb39fbba742b29aa10c45234bc488` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:36.063436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce00f-2434-4267-a7f5-cb0566cbb9fd admin admin] RBAC: Authorizing `identity:get_group(group_id=c59cb39fbba742b29aa10c45234bc488)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:36.065439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce00f-2434-4267-a7f5-cb0566cbb9fd admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:36.072683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 190/378] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:36 2022] GET /identity/v3/groups/c59cb39fbba742b29aa10c45234bc488 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:36.078638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:36.099569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a622ca5-51dc-4eb2-8f95-9e35b59d3ee4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:36.111619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:36.112800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:36.113136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:36.113392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:36.114591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] RBAC: Adding query filter params (group.id=c59cb39fbba742b29aa10c45234bc488, role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=1d8bb283e83f49d4ae1d0a1e9323f94b) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:36.115128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:36.117210 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050965-76f6-4af5-b20f-cfcefb9ebb9e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:36.129398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 189/379] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:36 2022] GET /identity/v3/role_assignments?group.id=c59cb39fbba742b29aa10c45234bc488&scope.project.id=1d8bb283e83f49d4ae1d0a1e9323f94b&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:37.536453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca991-8119-4461-9714-837157ba80c0 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.537008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca991-8119-4461-9714-837157ba80c0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.537008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca991-8119-4461-9714-837157ba80c0 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.538943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 191/380] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:37.544422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.544900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.544976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.569961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:37.571657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:37.579913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 190/381] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:37.607864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ca991-8119-4461-9714-837157ba80c0 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:37.622578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ca991-8119-4461-9714-837157ba80c0 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:37.627057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:37.627861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.628136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.628403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.643681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:37.650510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:37.652027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 192/382] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:37.658300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:37.679162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c375cd-36cc-4813-b32a-5eea6abda68b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:37.686241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:37.686947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.687219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.687580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.688526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:37.688895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:37.690722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:37.703957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 191/383] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:37.709448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:37.725902 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0482b5f-07cf-4567-a72d-7e067fa06626 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:37.737388 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2b544-d3c3-496d-b8d5-e73c5d8f25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:37.738266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2b544-d3c3-496d-b8d5-e73c5d8f25fc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.738539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2b544-d3c3-496d-b8d5-e73c5d8f25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.738804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2b544-d3c3-496d-b8d5-e73c5d8f25fc admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.745501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2b544-d3c3-496d-b8d5-e73c5d8f25fc admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:37.747438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2b544-d3c3-496d-b8d5-e73c5d8f25fc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:37.749463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 193/384] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:37 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:37.754947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:37.769864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740af8c1-90c2-4c51-9d2f-4607e06f0fba admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:37.777354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4497fc-a2fb-44bc-882c-23846f6b53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:37.777810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74552e34-c292-486b-b9ee-28b65f6d25ed None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.778137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74552e34-c292-486b-b9ee-28b65f6d25ed None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.778295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4497fc-a2fb-44bc-882c-23846f6b53ea admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.778460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74552e34-c292-486b-b9ee-28b65f6d25ed None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.778619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4497fc-a2fb-44bc-882c-23846f6b53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.778757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4497fc-a2fb-44bc-882c-23846f6b53ea admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.784613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 194/385] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:37.784856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4497fc-a2fb-44bc-882c-23846f6b53ea admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:37.784856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4497fc-a2fb-44bc-882c-23846f6b53ea admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:37.785397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 192/386] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:37 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:37.791138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74552e34-c292-486b-b9ee-28b65f6d25ed None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:37.796936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.797512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.798070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.810459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74552e34-c292-486b-b9ee-28b65f6d25ed None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:37.814855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:37.820744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.820744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.820744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307/groups/99ac7b097ad74e53991f1777e369f925/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.822398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de8007f03248b1ae1b7efb76862307, group_id=99ac7b097ad74e53991f1777e369f925, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:37.825187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:37.827028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:37.828431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:37.843509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 193/387] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 03 02:44:37.846879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 195/388] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 3 02:44:37 2022] PUT /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307/groups/99ac7b097ad74e53991f1777e369f925/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:37.878382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:37.888163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561d24-f456-44d3-afa6-68e8e081e407 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:37.965401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:37.966268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:37.966594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:37.966863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:37.982427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:37.990455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:37.991817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 194/389] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:37.997941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.019424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dd360-38bd-4e2c-adf9-63b1bc8d9008 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.028551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.029530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.029983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.030396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.031401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:38.031848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.033677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.051260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 196/390] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.057334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.086626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500cfbf-477a-4d1e-ace8-812660a136f6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.096299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.097213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.097488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.097762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.101595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.103533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.105559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 195/391] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.112602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.125743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e14234-7270-43d2-a8a3-b7b930b9e34e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.132122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222e62-9aa7-4e35-bc3c-64e3fc4fdd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.133416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222e62-9aa7-4e35-bc3c-64e3fc4fdd7a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.133896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222e62-9aa7-4e35-bc3c-64e3fc4fdd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.134374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222e62-9aa7-4e35-bc3c-64e3fc4fdd7a admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.135796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222e62-9aa7-4e35-bc3c-64e3fc4fdd7a admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.138107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222e62-9aa7-4e35-bc3c-64e3fc4fdd7a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.142583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 197/392] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.148572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.159682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bff39-b6a4-4a6e-8a08-d176de053293 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.164428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91557be-321d-4fd1-8c8f-7ff161510465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.165648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91557be-321d-4fd1-8c8f-7ff161510465 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.166146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91557be-321d-4fd1-8c8f-7ff161510465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.166625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91557be-321d-4fd1-8c8f-7ff161510465 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307/groups/99ac7b097ad74e53991f1777e369f925/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.169087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91557be-321d-4fd1-8c8f-7ff161510465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de8007f03248b1ae1b7efb76862307, group_id=99ac7b097ad74e53991f1777e369f925, role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.172320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91557be-321d-4fd1-8c8f-7ff161510465 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.193404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 196/393] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 3 02:44:38 2022] PUT /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307/groups/99ac7b097ad74e53991f1777e369f925/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:38.216937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce0bb9-3cf9-4d60-b7a7-1ee5c1633a77 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.217559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce0bb9-3cf9-4d60-b7a7-1ee5c1633a77 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.218018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce0bb9-3cf9-4d60-b7a7-1ee5c1633a77 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.220301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 198/394] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:38.226207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.226729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.227008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.247824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:38.249097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:38.325740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 197/395] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:38.360766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce0bb9-3cf9-4d60-b7a7-1ee5c1633a77 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.374413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce0bb9-3cf9-4d60-b7a7-1ee5c1633a77 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.379230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.380106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.380383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.380653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.395848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:38.403121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:38.404883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 199/396] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:38.413252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.422747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d470e-acce-43b5-b966-ffd7f96d43f5 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.428059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.428748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.429040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.429311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.430128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:38.430437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.432061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.443260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 198/397] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.448530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.460315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a25a8-3550-4a07-9cce-6b11c2b502ab admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.465622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.466485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.466770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.467012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.468257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.470199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.471984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 200/398] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.477643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.487870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bb6d-4b42-4f7c-a12c-f7cc4d42c033 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.492289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8afe6-1830-4278-ad43-a330e409b46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.493190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8afe6-1830-4278-ad43-a330e409b46a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.493465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8afe6-1830-4278-ad43-a330e409b46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.493729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8afe6-1830-4278-ad43-a330e409b46a admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.494919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8afe6-1830-4278-ad43-a330e409b46a admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.496995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8afe6-1830-4278-ad43-a330e409b46a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.498665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 199/399] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.504637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.515145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70642b-0af6-4a8f-96f4-9142e61f32ed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.520856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de347cb-cacf-49dd-aa54-5cc77bdfc316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.521822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de347cb-cacf-49dd-aa54-5cc77bdfc316 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.522059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de347cb-cacf-49dd-aa54-5cc77bdfc316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.522325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de347cb-cacf-49dd-aa54-5cc77bdfc316 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c/groups/99ac7b097ad74e53991f1777e369f925/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.524281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de347cb-cacf-49dd-aa54-5cc77bdfc316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75afbd1f554f0fa2853845b593086c, group_id=99ac7b097ad74e53991f1777e369f925, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.526921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de347cb-cacf-49dd-aa54-5cc77bdfc316 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.542541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 201/400] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 3 02:44:38 2022] PUT /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c/groups/99ac7b097ad74e53991f1777e369f925/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:44:38.613521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7af562-4f95-4680-bdb9-455e791ecfbc None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.614030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7af562-4f95-4680-bdb9-455e791ecfbc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.614030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7af562-4f95-4680-bdb9-455e791ecfbc None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.615891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 200/401] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:38.622319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.622599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.622904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.643146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:38.644434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:38.706115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 202/402] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:38.730265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7af562-4f95-4680-bdb9-455e791ecfbc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.744155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7af562-4f95-4680-bdb9-455e791ecfbc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.748628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.749600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.749879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.750144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.762135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:38.769630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:38.772973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 201/403] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:38.777495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.787102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cee08-f1d2-4bb5-9eef-d83156433c49 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.793098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.793845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.794120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.794431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.795205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:38.795556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.797429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.810024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 203/404] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.813460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.825212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78e4ab-be13-4f97-ac4e-5b9095137db9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.830018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.830947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.831213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.831478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.832790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.834826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.836827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 202/405] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.853722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.864706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de3bf-18f2-442b-9dcb-dea9bb3aed47 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.871752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b17ab9-585d-4101-841d-a27c1f33baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.872631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b17ab9-585d-4101-841d-a27c1f33baf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.872938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b17ab9-585d-4101-841d-a27c1f33baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.873208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b17ab9-585d-4101-841d-a27c1f33baf5 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.874486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b17ab9-585d-4101-841d-a27c1f33baf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.876548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b17ab9-585d-4101-841d-a27c1f33baf5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.878252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 204/406] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:38 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:38.884023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:38.894128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd12a3-f638-4479-a2de-b0e2a755aace admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:38.900822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892e9c5-4df0-4fbb-aac6-3d854ec22897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:38.901794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e9c5-4df0-4fbb-aac6-3d854ec22897 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:38.902138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e9c5-4df0-4fbb-aac6-3d854ec22897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:38.902473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e9c5-4df0-4fbb-aac6-3d854ec22897 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c/groups/99ac7b097ad74e53991f1777e369f925/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:38.904841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e9c5-4df0-4fbb-aac6-3d854ec22897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75afbd1f554f0fa2853845b593086c, group_id=99ac7b097ad74e53991f1777e369f925, role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:38.907775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e9c5-4df0-4fbb-aac6-3d854ec22897 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:38.927118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 203/407] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 3 02:44:38 2022] PUT /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c/groups/99ac7b097ad74e53991f1777e369f925/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:39.484967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0321a-d58f-4c19-a4f7-1f6836ee69ff None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.485245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0321a-d58f-4c19-a4f7-1f6836ee69ff None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.485518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0321a-d58f-4c19-a4f7-1f6836ee69ff None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.487734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 205/408] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:39.493125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.493405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.493667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.513649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:39.514818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:39.586348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 204/409] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:39.626628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0321a-d58f-4c19-a4f7-1f6836ee69ff None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:39.638915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0321a-d58f-4c19-a4f7-1f6836ee69ff None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:39.648708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:39.649525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.649792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.650056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.662423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:39.669080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:39.670445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 206/410] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:39.676446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:39.685603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7578-7b85-464b-ab08-56ebf1a75739 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:39.694659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:39.695339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.695610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.695871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.696635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:39.696951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:39.698557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:39.707373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 205/411] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:39.713136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:39.729878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8317367-e27c-4ba1-8af1-fb2212a0230e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:39.734548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:39.735446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.735664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.735931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] PATH_INFO: `/v3/groups/c59cb39fbba742b29aa10c45234bc488` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.737965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c59cb39fbba742b29aa10c45234bc488)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:39.739920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:39.741834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 207/412] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:39 2022] GET /identity/v3/groups/c59cb39fbba742b29aa10c45234bc488 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:39.747498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:39.757410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f540-904f-49c1-beb7-eeb2cb654af9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:39.764742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f25dd-deaa-4423-a82a-8ce25d7aa18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:39.765672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f25dd-deaa-4423-a82a-8ce25d7aa18b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.765944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f25dd-deaa-4423-a82a-8ce25d7aa18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.766209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f25dd-deaa-4423-a82a-8ce25d7aa18b admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.767419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f25dd-deaa-4423-a82a-8ce25d7aa18b admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:39.769311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f25dd-deaa-4423-a82a-8ce25d7aa18b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:39.770965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 206/413] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:39 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:39.777741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:39.790392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122d94-bf46-4432-abb6-5a5843b47da0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:39.797369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa489-8232-4868-aab6-14634304f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:39.798815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa489-8232-4868-aab6-14634304f2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:39.799299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa489-8232-4868-aab6-14634304f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:39.799819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa489-8232-4868-aab6-14634304f2c3 admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b/groups/c59cb39fbba742b29aa10c45234bc488/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:39.802109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa489-8232-4868-aab6-14634304f2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b, group_id=c59cb39fbba742b29aa10c45234bc488, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:39.805257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa489-8232-4868-aab6-14634304f2c3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:39.834306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 208/414] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 3 02:44:39 2022] PUT /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b/groups/c59cb39fbba742b29aa10c45234bc488/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:44:40.870431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4a34-f09a-4e37-9467-30e323424250 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:40.871004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4a34-f09a-4e37-9467-30e323424250 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:40.871004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4a34-f09a-4e37-9467-30e323424250 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:40.873024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 207/415] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:40.886656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:40.887607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:40.888087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:40.917758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:40.919352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:40.982409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 209/416] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:41.020046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4a34-f09a-4e37-9467-30e323424250 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.042154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4a34-f09a-4e37-9467-30e323424250 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.046714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.047512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.047782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.048045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.066302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:41.073219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:41.074793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 208/417] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:41.085336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.101576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ea4fb-ab78-45b5-bce8-3b6413ca181a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.113652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.114701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.115187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.115653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.116640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.117173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.119018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.135719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 210/418] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.141036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.154364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c8b6-2e8e-4d66-a215-45b273d98741 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.164904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.165561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.165837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.166103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.181285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.183105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.198314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 209/419] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:41.204037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.220804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d445b3a-2817-4a35-8421-80c9dfb5b975 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.231129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.232386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.232959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.233443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.237843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.240254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.242492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 211/420] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.247908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.261063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc265df-6b93-41ae-9794-74eba2611427 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.265737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f81c0-094a-46c3-9881-3f193d3b9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.266582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f81c0-094a-46c3-9881-3f193d3b9616 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.266860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f81c0-094a-46c3-9881-3f193d3b9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.267123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f81c0-094a-46c3-9881-3f193d3b9616 admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.273419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f81c0-094a-46c3-9881-3f193d3b9616 admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.275320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f81c0-094a-46c3-9881-3f193d3b9616 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.276930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 210/421] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.282859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.295304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b6a9-d7a2-4232-b204-588a8349723f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.302118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.303105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.303596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.304125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.305202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=d2de8007f03248b1ae1b7efb76862307) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.305753 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.307909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714c427-2ad3-4d80-bca3-6988f60127e6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.322120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 212/422] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.484081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9cefe-3679-4ed5-9ff4-ddec678c718b None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.484268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9cefe-3679-4ed5-9ff4-ddec678c718b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.484553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9cefe-3679-4ed5-9ff4-ddec678c718b None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.486668 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 211/423] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:41.492823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1202-caa7-4d8c-83a4-a3c6a74cc585 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.493372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1202-caa7-4d8c-83a4-a3c6a74cc585 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.493716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1202-caa7-4d8c-83a4-a3c6a74cc585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.517425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e83e1202-caa7-4d8c-83a4-a3c6a74cc585 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:41.519010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e83e1202-caa7-4d8c-83a4-a3c6a74cc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:41.528298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 213/424] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:41.570717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9cefe-3679-4ed5-9ff4-ddec678c718b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.586671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9cefe-3679-4ed5-9ff4-ddec678c718b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.591508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.593856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ab87-717b-468d-9dbc-593844ff2e1c None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.594340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ab87-717b-468d-9dbc-593844ff2e1c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.594773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ab87-717b-468d-9dbc-593844ff2e1c None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.596950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 214/425] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:41.597840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.598400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.598873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.606232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.606957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.607393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.617911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:41.625699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:41.631761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 212/426] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:41.634148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:41.635525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:41.641971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.644866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 215/427] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:41.655884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1187af-44ff-460e-bdfa-ecfeca20ffe3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.663112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.663852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.665487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.665487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.665487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.665755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.667917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.679248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 213/428] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:41.685051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.701078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5e94d-7efd-4f96-aa3d-30d31753dfd7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.706465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.706632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.707634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.708058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.708486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.717772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.718275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51537e-b08f-4c84-ba06-4a8f640f7374 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.720092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.731114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93b4ef-32ee-4e43-9696-f100fd2a0120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.731995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93b4ef-32ee-4e43-9696-f100fd2a0120 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.732265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93b4ef-32ee-4e43-9696-f100fd2a0120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.732583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93b4ef-32ee-4e43-9696-f100fd2a0120 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.733872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 216/429] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:41.740839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.750293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad70de6-c232-405f-b7af-2110c01bbcba admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.753384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93b4ef-32ee-4e43-9696-f100fd2a0120 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:41.759983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.760600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3f93b4ef-32ee-4e43-9696-f100fd2a0120 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:41.760870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.761147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.761417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.762016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 214/430] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:41.763094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076056e-83e3-47b3-bc7e-2cc05bf0c364 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.763378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076056e-83e3-47b3-bc7e-2cc05bf0c364 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.763646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076056e-83e3-47b3-bc7e-2cc05bf0c364 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.763811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.766124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.767940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 217/431] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.769627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 215/432] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:41.773090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.777299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.777565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.777832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.784984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281a79a-6a34-47a6-86ae-064d95e89b2a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.793053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.793918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.794194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.794460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.795657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.797799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.799703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 218/433] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:41.800469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.803962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:41.805592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:41.814841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 216/434] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:41.815924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.816701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cefdcc-4a3a-447c-9898-46f94c9d9d09 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.821198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.821855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.822133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.822404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.823161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.823464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.825091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.827269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5912c-e2f3-4173-8c02-7a30a14ce83d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.833626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 219/435] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.837226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.838299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.838852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.839208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.839686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.840939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=3e75afbd1f554f0fa2853845b593086c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.841486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.843711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.849921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69363b-f2f9-4898-b7fe-69e687f95096 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.851083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 217/436] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.852253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.861068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.862386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.862928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.863387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.863497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9c16-21fc-47bb-be83-13081d6316ac admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.868357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.869383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.869753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.870118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.875102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.877417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.883607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:41.889673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 220/437] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:44:41.891471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 03 02:44:41.896770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 218/438] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:41.898230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.899343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.914414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a015-0e1f-425d-aec2-38697967a9ac admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.916449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef1d4-97e2-4acd-8b4e-e61a7274f849 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.922769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.923709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.924013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.924271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.925546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.925703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.926579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.927027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.927490 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.927771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.928635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.929141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.929972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 221/439] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.931395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.934987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.944307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 219/440] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:41.953226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.955772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a060-c97e-4b7e-b32e-580339c202c3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.960639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.961722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.962664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.962664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.963786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.965886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.966796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c1ff-02f6-4dac-8b9d-8e1fa8ab9b78 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.967937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 222/441] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:41.972557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.973422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.973821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.973988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:41.974257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.983542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.984911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8068-591f-4f36-b853-1a08f6c5b2f3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:41.985996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:41.992412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:41.993201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:41.993578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:41.993947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:41.994903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=d2de8007f03248b1ae1b7efb76862307) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:41.995310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:41.997341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.003447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 220/442] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:44:42.004647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 223/443] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:41 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=d2de8007f03248b1ae1b7efb76862307&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:42.007234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.017727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f460bf-f870-464a-a17c-483209c039de admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.023147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.024420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.024941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.025395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] PATH_INFO: `/v3/projects/3e75afbd1f554f0fa2853845b593086c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.027068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e75afbd1f554f0fa2853845b593086c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.029635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.036844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 221/444] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/projects/3e75afbd1f554f0fa2853845b593086c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:42.040004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.051832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad64ea-c7c1-4452-b19f-57cf17578522 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.057210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a029-cc94-4b31-9b9e-d15b0f34835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.058434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a029-cc94-4b31-9b9e-d15b0f34835e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.058884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a029-cc94-4b31-9b9e-d15b0f34835e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.059338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a029-cc94-4b31-9b9e-d15b0f34835e admin admin] PATH_INFO: `/v3/groups/99ac7b097ad74e53991f1777e369f925` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.060904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a029-cc94-4b31-9b9e-d15b0f34835e admin admin] RBAC: Authorizing `identity:get_group(group_id=99ac7b097ad74e53991f1777e369f925)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.063206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a029-cc94-4b31-9b9e-d15b0f34835e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.065150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 224/445] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/groups/99ac7b097ad74e53991f1777e369f925 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:42.072445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.085170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374bd58-7b04-43dd-9235-e41ce1b95b74 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.091885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.092930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.093444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.093914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.094918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] RBAC: Adding query filter params (group.id=99ac7b097ad74e53991f1777e369f925, role.id=4e7921a08ea049ac85d7f219cc8c8fc7, scope.project.id=3e75afbd1f554f0fa2853845b593086c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:42.095422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.097610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56993d-be30-4fd3-b93d-8d76004d9d44 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.106622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 222/446] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/role_assignments?group.id=99ac7b097ad74e53991f1777e369f925&scope.project.id=3e75afbd1f554f0fa2853845b593086c&role.id=4e7921a08ea049ac85d7f219cc8c8fc7 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:42.625769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d83c59-4704-4035-b99a-d4a99021f0af None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.626029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d83c59-4704-4035-b99a-d4a99021f0af None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.626338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d83c59-4704-4035-b99a-d4a99021f0af None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.628144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 225/447] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:42.634082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.634364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.634636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.653524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:42.654672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:42.662662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 223/448] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:42.686180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d83c59-4704-4035-b99a-d4a99021f0af None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.699026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d83c59-4704-4035-b99a-d4a99021f0af None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.703759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.704555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.704866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.705135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.719001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:42.725864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:42.727045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 226/449] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:42.732857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.742207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee0284-10a2-449c-a96b-06bee1dddf74 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.748974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.749638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.749913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.750178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.750949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:42.751251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.752907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.761461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 224/450] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:42.767295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.777381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79199-8211-4914-a4a2-315582acb596 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.782447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.783098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.783369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.783640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.792023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.793857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.803217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 227/451] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:42.808701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.818466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3945-7ff3-4fdd-9623-dfe2ba11818d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.824285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.825310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.825586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.825853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.827046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.828929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.830593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 225/452] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:42.835928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.845017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2394-0854-4ab0-9568-6f016e2ab651 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.849354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e367-6397-4be0-a49c-3544766d782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.850193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e367-6397-4be0-a49c-3544766d782c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.850469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e367-6397-4be0-a49c-3544766d782c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.850736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e367-6397-4be0-a49c-3544766d782c admin admin] PATH_INFO: `/v3/groups/c59cb39fbba742b29aa10c45234bc488` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.851911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7e367-6397-4be0-a49c-3544766d782c admin admin] RBAC: Authorizing `identity:get_group(group_id=c59cb39fbba742b29aa10c45234bc488)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.853838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7e367-6397-4be0-a49c-3544766d782c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.855405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 228/453] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/groups/c59cb39fbba742b29aa10c45234bc488 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:42.861068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:42.871483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3254aa-925c-4833-b417-85cd0f282588 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:42.876924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:42.877522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:42.877793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:42.878057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:42.878898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] RBAC: Adding query filter params (group.id=c59cb39fbba742b29aa10c45234bc488, role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=1d8bb283e83f49d4ae1d0a1e9323f94b) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:42.879199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:42.881095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d40ee-1d5c-4832-b8dd-eac8540414c8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:42.887482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 226/454] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 3 02:44:42 2022] GET /identity/v3/role_assignments?group.id=c59cb39fbba742b29aa10c45234bc488&scope.project.id=1d8bb283e83f49d4ae1d0a1e9323f94b&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:45.604439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45804d8-00f9-4ff2-a688-c0e000af1857 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.604989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45804d8-00f9-4ff2-a688-c0e000af1857 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.604989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45804d8-00f9-4ff2-a688-c0e000af1857 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.607025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 229/455] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:45.613160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.613612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.613785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.638436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8f837-0f1b-44fe-ae70-f9e4e90ed5c1 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.638436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8f837-0f1b-44fe-ae70-f9e4e90ed5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.638436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8f837-0f1b-44fe-ae70-f9e4e90ed5c1 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.639820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 230/456] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:45.645907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.646239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.646460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.652029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:45.655481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:45.677493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 227/457] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:45.678380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:45.679589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:45.695211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 231/458] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:45.712828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:45.722435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a3d4-fdad-46e2-b483-56060dde6d2b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:45.731990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:45.732681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:45.732840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.733100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.733369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.742601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff9c58-93a6-4603-b441-570b54630380 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:45.745048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:45.746895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:45.757424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:45.758247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.758527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.758799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.766781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:45.767993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 228/459] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:45.773705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:45.775103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:45.776991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:45.788208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a51b9-c2ca-4b14-8791-6377376c7cd7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:45.801269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:45.801935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.802212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.802482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.803226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:45.803528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:45.805188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:45.814484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:45.815715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 232/460] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:45.822635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:45.832612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 229/461] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:45.837780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:45.839275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcfa99-d32d-47ff-88cc-4338bd91db87 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:45.851514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50c0f-ec84-44cf-ada3-1bc21726a09a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:45.853891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:45.854616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.854840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.855114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.855858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:45.856170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:45.857229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:45.857229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:45.857229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:45.858115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:45.866519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb45f45-16a8-4f3f-8290-345ea79871f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:45.867199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb45f45-16a8-4f3f-8290-345ea79871f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.867478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb45f45-16a8-4f3f-8290-345ea79871f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.867750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb45f45-16a8-4f3f-8290-345ea79871f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.868492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb45f45-16a8-4f3f-8290-345ea79871f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:45.870452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb45f45-16a8-4f3f-8290-345ea79871f5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:45.896864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 233/462] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:45.905027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:45.908081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 230/463] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:45 2022] POST /identity/v3/users => generated 248 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:44:45.909809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2451d-1a10-4f82-8bf4-7cdd27db2ae8 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.910211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2451d-1a10-4f82-8bf4-7cdd27db2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.910571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2451d-1a10-4f82-8bf4-7cdd27db2ae8 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.920747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 231/464] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:45.922638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.922929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.923201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.925627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fc31-176c-47b6-8415-cc9fe3c9acf8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:45.935803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:45.936504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:45.939293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:45.939609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:45.941711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:45.946001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:45.963719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:45.965968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:45.981064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 232/465] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:45.991290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 234/466] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:45 2022] POST /identity/v3/users => generated 246 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:46.010132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:46.020155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fb4e9-11e5-4d05-9dfc-bdee3a4155b4 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:46.029084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:46.030274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.030613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.031109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.044318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:46.046429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:46.069582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:46.069582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 233/467] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:46.075771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:46.099736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7266e-a514-46c6-beb3-aa532248b52e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:46.110146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:46.110775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.111059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.111334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.112475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:46.112822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:46.114517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c16b-15ae-4f70-8e2d-08da48c001a8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:46.129539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 235/468] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:46.135198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:46.151641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f50bbe-ab23-406c-8efb-33b176067c84 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:46.156475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124554a8-1340-49c3-b2d7-08fcfd54ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:46.157246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124554a8-1340-49c3-b2d7-08fcfd54ae6a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.157522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124554a8-1340-49c3-b2d7-08fcfd54ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.157796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124554a8-1340-49c3-b2d7-08fcfd54ae6a admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.158649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124554a8-1340-49c3-b2d7-08fcfd54ae6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:46.160671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124554a8-1340-49c3-b2d7-08fcfd54ae6a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:46.191216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 234/469] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:46 2022] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:46.447097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f3e1-7dae-4f43-a2b5-5ae444f1b19d None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.447492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f3e1-7dae-4f43-a2b5-5ae444f1b19d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.447655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f3e1-7dae-4f43-a2b5-5ae444f1b19d None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.449758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 236/470] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:46.455155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.455680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.456159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.479271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:46.480838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:46.491711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 235/471] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:46.518010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196f3e1-7dae-4f43-a2b5-5ae444f1b19d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:46.536350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196f3e1-7dae-4f43-a2b5-5ae444f1b19d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:46.542144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:46.542942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.543227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.543503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.555818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:46.557953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:46.575919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:46.577557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 237/472] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:46.584078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:46.600196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885f826-2040-4acb-a10e-cbcef4dbf716 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:46.609131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:46.609807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.610085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.610354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.611094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:46.611397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:46.613449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cc7a5-49a8-42a7-876b-c4bd40dee0ed admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:46.634973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 236/473] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:46.640613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:46.654020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd8b12-4165-4aec-98d4-007cd59c6ae4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:46.660457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffe084-d5ff-492b-a8ed-bdbff800ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:46.661194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe084-d5ff-492b-a8ed-bdbff800ee7f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.661473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe084-d5ff-492b-a8ed-bdbff800ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.661749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe084-d5ff-492b-a8ed-bdbff800ee7f admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.662527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe084-d5ff-492b-a8ed-bdbff800ee7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:46.664518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe084-d5ff-492b-a8ed-bdbff800ee7f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:46.706506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 238/474] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:46 2022] POST /identity/v3/users => generated 249 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:44:46.972347 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5682b9f-9a77-4232-806a-549271ccc08e None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.972758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5682b9f-9a77-4232-806a-549271ccc08e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.972937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5682b9f-9a77-4232-806a-549271ccc08e None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:46.975012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 237/475] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:46.986843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:46.988139 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:46.988936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:47.016231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:47.017471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:47.030094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 239/476] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:47.066128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5682b9f-9a77-4232-806a-549271ccc08e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:47.109433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5682b9f-9a77-4232-806a-549271ccc08e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:47.119054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:47.119735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:47.120057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:47.120328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:47.121152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:47.122765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:47.137950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.sql.core [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 03 02:44:47.137950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 03 02:44:47.137950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [parameters: {'id': 'b462fc8c4c4b4586bf2f7fea0d0c5cc0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 03 02:44:47.137950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 03 02:44:47.152152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 03 02:44:47.153918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 238/477] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:44:47 2022] POST /identity/v3/roles => generated 144 bytes in 88 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:47.159829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:47.173775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb47bb4-8081-4b5a-b40a-5758194ea174 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:47.191826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c948-b4a1-4d9b-94ff-58c0dbf33cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:47.192984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c948-b4a1-4d9b-94ff-58c0dbf33cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:47.193474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c948-b4a1-4d9b-94ff-58c0dbf33cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:47.193932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c948-b4a1-4d9b-94ff-58c0dbf33cfe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:47.208824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9c948-b4a1-4d9b-94ff-58c0dbf33cfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:47.218780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-28c9c948-b4a1-4d9b-94ff-58c0dbf33cfe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 03 02:44:47.220588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 240/478] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:47.240185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:47.258209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ae2b-e6e6-45db-b85b-fd5f6f107859 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:47.267121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:47.268299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:47.268844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:47.269322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:47.270343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:47.270866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:47.272892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc147-6e4f-4d6e-b054-18ff575ed722 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:47.282998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 239/479] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:48.674101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4244e-59f0-4f51-add6-ed4919a66c04 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.674627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4244e-59f0-4f51-add6-ed4919a66c04 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.674627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4244e-59f0-4f51-add6-ed4919a66c04 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.676866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 241/480] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:48.682471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.682859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.683035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.702534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:48.703738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:48.714858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 240/481] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:48.762260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4244e-59f0-4f51-add6-ed4919a66c04 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:48.778611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4244e-59f0-4f51-add6-ed4919a66c04 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:48.785833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2fd5b-78f3-4b3b-91ec-0047ba4125b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:48.786638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2fd5b-78f3-4b3b-91ec-0047ba4125b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.786905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2fd5b-78f3-4b3b-91ec-0047ba4125b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.787182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2fd5b-78f3-4b3b-91ec-0047ba4125b9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.802802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2fd5b-78f3-4b3b-91ec-0047ba4125b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:48.809596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1fa2fd5b-78f3-4b3b-91ec-0047ba4125b9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:48.811103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 242/482] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:48.816783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:48.829683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2e9b-cac9-4418-9d9c-5a6fa1589e63 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:48.836759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:48.837429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.837706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.837978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.838751 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:48.839055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:48.840667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:48.848837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3a68-049c-43a8-aa81-385753f7424a None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.848837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3a68-049c-43a8-aa81-385753f7424a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.848837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3a68-049c-43a8-aa81-385753f7424a None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.849574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 243/483] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:48.854557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.855060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.855537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.855996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 241/484] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:48.861094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:48.877438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b798-23b7-4d2d-b147-7bacaa179cd3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:48.879077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:48.881509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:48.887519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:48.888647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.890283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.890788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.909182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 244/485] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:48.916615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:48.918841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:48.934261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:48.942053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:48.943293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 242/486] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:48.944165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6021b-9cf9-41b6-8450-0210cbf6abdf None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:48.948646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:48.958459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:48.959576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.960038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.960491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.968889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0a038-9a68-4074-9e38-cae15a90336b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:48.978428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:48.979367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:48.980056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:48.980538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:48.981283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:48.985642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:48.985967 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:48.987962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:48.989187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:48.990890 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 245/487] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:48.996653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.010658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeec7f-f007-40ae-91e5-322849ba92e3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.011882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 243/488] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.014159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.023228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.024181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.024824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.025288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.026255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.026747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.028561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.034325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c4ce-6d06-4ef2-a27b-b3cab1d05362 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.049536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.050659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.051125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.051598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.052412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 246/489] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.054192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.060606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.063296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.074503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281d86-720c-4b62-a817-fff21aca3d81 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.089641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:44:49.091445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 244/490] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:49.098821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.102265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.104101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.104432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.104711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.118186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1ed9-370a-4a39-b1cb-62badb33f90d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.127764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.128502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.130808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.131092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.131364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.132592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.133407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.134903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.136792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:49.136792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:44:49.136792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:44:49.140368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21526bd6-1b77-4294-ac79-48538416de04 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.166266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-54332e03-6066-416f-a50e-79cdee4248df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:49.167642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 247/491] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.173754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4637-728b-4f62-8e1a-2d33eb547624 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.174037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4637-728b-4f62-8e1a-2d33eb547624 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.174309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4637-728b-4f62-8e1a-2d33eb547624 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.176183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 248/492] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:49.176836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae4637-728b-4f62-8e1a-2d33eb547624 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.190701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae4637-728b-4f62-8e1a-2d33eb547624 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.195006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.195647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.195925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.196195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.196972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.197284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.199775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.202613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 245/493] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.204175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.204660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.205162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.217720 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 249/494] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.220816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.227891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:49.228367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f3ff-a7fc-4a65-8982-eefd34c94da5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.229269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:49.232963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.233774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.234056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.234331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.238068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 246/495] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:49.243930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.245679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.245793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.254944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e718-2b40-45ab-ae70-431f13f86f05 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.259528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 250/496] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:49.260861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.270096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97445-6d6f-4788-9617-47925a0d878d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.274721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.274850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.275525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.275711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.275802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.276028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.276121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.276271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.284702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.286774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.288078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.289973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.300588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 03 02:44:49.301911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 247/497] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.302676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.308706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:49.314443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 251/498] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.315305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.316844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd419e-f574-4608-bc2a-3033a230f0b3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.321300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.322082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.322365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.322630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.326129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d3d8-5142-4d4f-a127-c9a2a3bf9fd6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.330831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.331486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.331806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.332077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.333046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.333295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:49.333454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.334465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:49.334465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:49.334465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:49.335671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.340145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:49.341379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 248/499] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.342146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.356832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4c30-b562-4d60-98b4-292c46534c82 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.361442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.362528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.362846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.363125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.363958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.364259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.366056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.377881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 249/501] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.378698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.382404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 252/501] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.383928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.393376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c75c7-9316-40ba-8c7a-24a04a6cbf75 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.393629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09da6d-b3ad-4799-b452-0a902fba2d11 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.397926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.398402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.398685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.398977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.399182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.399334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.399470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.399724 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.400201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.400553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.402363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.407234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.409416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.416794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 250/502] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.417896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.425050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:49.428990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b240db3-0aa2-4a8a-81c0-065b3697455c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.431157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 253/503] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:49.432257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.435525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.436344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.436777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.437125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.443394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d58d-6de0-4132-baf2-18541a93c4d9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.446845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.448000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.448770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.448978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.449329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.449670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.458464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 251/504] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:49.460700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.462584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.463535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.472742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53878d-2926-44ce-a084-adfbe69f04c5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.477247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.477928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.478194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.478487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.479365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.479665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.480110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:49.480748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:49.480748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:44:49.480748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:44:49.481320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 254/505] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.482147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.486632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.492364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034d067-6e45-413a-a316-8e93aa58174e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.497084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.497855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.498289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.498567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.505859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 252/506] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.506800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.518886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.520960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.523149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae15f37-5d10-44b7-9ffb-4490e30b928a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.528955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.529620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.529955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.530256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.531174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.531480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.533254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.539396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:49.540619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 255/507] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.541490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.551709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fef8-ac3d-44f7-83da-361103086e8b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.552940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 253/508] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.553836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.556432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.557154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.557440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.557711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.558911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=a5e2802cd72344deb281b227f9acb3a0) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.559225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.561165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.568196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05e4f-a158-4ebc-b3f3-72b437486ea8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.572817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 256/509] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/role_assignments?user.id=a5e2802cd72344deb281b227f9acb3a0&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.573839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.585480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.586242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.586521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.592845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.592845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.592845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.592845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.598376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da0072-7350-4ace-835e-4da1f3c48d04 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.610134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.612848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.613129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.613400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.621866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 254/510] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.630903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.635718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.640074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.647268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168a94e-d140-4c43-9d08-d316267209b6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.656775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.657649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.657930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.658203 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.674798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9ed1ca26-0fe2-468f-affc-59626f17c93c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 03 02:44:49.676108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 257/511] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.677600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.680006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.681837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba58a-ec81-459a-9c39-d6792b0e8b47 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.682402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba58a-ec81-459a-9c39-d6792b0e8b47 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.682873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba58a-ec81-459a-9c39-d6792b0e8b47 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.685146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 258/512] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:49.686049 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba58a-ec81-459a-9c39-d6792b0e8b47 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.696475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-1a9cb52c-3a94-4ed4-9af3-d71d05ffb574 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:49.698752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 255/513] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.701188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.701575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.701966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.704613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba58a-ec81-459a-9c39-d6792b0e8b47 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.709233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.710120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.710549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.710822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.711684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.711981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.713932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.725118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:49.726913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:49.733613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 259/514] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.734541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.738418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 256/515] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:49.739520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.750792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec4a7-c39b-405b-b1a6-1a70eb3311b6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.754154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900915-8ad4-4e19-b9f9-08b81f00e2f3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.756603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.757667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.758199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.758669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.771957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.772599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.773369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.773645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.773914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.774722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.775025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.775571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.776068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:44:49.776068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:44:49.776068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:44:49.777405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.791773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 257/516] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:49.793596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.797421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 260/517] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.802741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.803206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d02e5-662f-44c0-9184-60a03e7e850b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.807494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.808273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.808550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.808856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.812452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3410dd7-5053-450b-ac5e-bb14f48b8922 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.817098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.818042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.818459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.818869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.824678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:49.829824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.831839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.833587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:49.840248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 258/518] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.840248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.848294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2799-f58b-4908-b9a7-ebe68572d0c3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.853261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.854006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.854356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.854778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.855353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:49.855775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=3a83aa4460fb48469b62d1069358ec73) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.856186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.857131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 261/519] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:49.858072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.858620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.872761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 259/520] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/role_assignments?user.id=3a83aa4460fb48469b62d1069358ec73&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.872761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.874717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbb807-3923-457e-879b-22ef6c204dbe admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.878667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89cbe3-95ce-4a28-943e-8da4e9ca6ad9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.884072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.885664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.886433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.887883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.888376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.890136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.890600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.890846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.891298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.891726 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.893468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:49.895002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.895487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.899230 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.915809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 262/521] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.922309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.927723 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 260/522] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:49.929366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:49.941579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db521c16-bd3c-4dcf-a344-129b42aa12d2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.944246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e2ef-0bac-4225-8306-fe2d87a8d303 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:49.949458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.949655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:49.950336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.950604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.950885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.951160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:49.951578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:49.951986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:49.972391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.977648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.984244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:49.993862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:49.999947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:50.002410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 261/523] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:50.008856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.026146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:50.027678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 263/524] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:50.031427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597fe5-6c9c-4071-870a-2d921c2c9a4a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.033552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.044179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.045167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.045597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.046085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.047079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.047552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.053193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed83b-53c8-4ee2-b98c-540d3c6e6470 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.053869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.072312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.073289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.073725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.074138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.075012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.075453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.077323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.082087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 262/525] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:50.086962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.095748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 264/526] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:50.101116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.110553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85756d-614d-48f6-9e35-36ba14db17b9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.112534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825136f-9b59-41b5-bdf5-1400e730d6db admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.121365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.122201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.122476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.123651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.125012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.127051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.127324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.127774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.130431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=30865d753bcb4542bee3b1c86a14b51e) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.134816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.136828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.137021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.138742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.150915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 03 02:44:50.151243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 263/527] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/role_assignments?user.id=30865d753bcb4542bee3b1c86a14b51e&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:50.152195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 265/528] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:50.157927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.174452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce226e2-4b76-411a-aeb2-ca8351cdb8a6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.187641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.188373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.188656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.188958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.189981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.190291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.192245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021f63-214f-401b-aba6-541ff0da3501 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.228798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 264/529] 10.222.0.31 () {56 vars in 1160 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:50.234131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.249891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50110-b68e-4fe3-a649-7a528fc3d5dd admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.262908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.263582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.263904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.264169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.267208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4d61-9ed0-41b8-b7ec-4dc7a2051a5f None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.267496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4d61-9ed0-41b8-b7ec-4dc7a2051a5f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.267775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4d61-9ed0-41b8-b7ec-4dc7a2051a5f None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.269864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 265/530] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:50.281066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.281680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.281987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.282337 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.282885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.299137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 266/531] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:50.302775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:50.304323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:50.304558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.312915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 266/532] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:50.321332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb496-8781-497e-a305-79d542d2e22b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.333379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.334198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.334483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.334754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.340099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.351287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8673c-fef5-49dc-beae-c199f1534004 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.352925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.354809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.356291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.357181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.357466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.357799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.370597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.372544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.388496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:50.389809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 267/533] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:50.392086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:50.393621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 267/534] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:50.395496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.399478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.410908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01f9b-3067-4479-a9f3-2fbc8a328c4d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.412293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327108-ceed-40f7-bff1-6d3a5ee6bd7d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.415661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.416397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.416679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.416988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.417805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.418213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.420153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.425463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.426151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.426425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.426697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.427438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.427745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.429392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.434287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 268/535] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:50.440603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.451849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 268/536] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:50.452026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e882e-2845-4532-8b28-2220c961621f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.457119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.457298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.458280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.458705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.459242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.460149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.462399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.472243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced593-29db-4b3c-a7f4-f8ab1fe93a41 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.478129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.479196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.480018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.480018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.488446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.490544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.501518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 269/537] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:44:50 2022] POST /identity/v3/users => generated 247 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:44:50.509867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:50.511471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 269/538] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:50.517293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.538529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291cfe-be09-4a67-b6c4-1aa6b85e8137 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.547785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.548620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.549125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.549512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.550499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.550896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.553003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924800a-f121-45db-af74-4e5455c4a7d4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.576782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 270/539] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:50.583080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:50.597772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43bb01-dc6a-4607-83cb-8dd1a084de50 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:50.610660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:50.611335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:50.611612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:50.611883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:50.613156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=482bb28bcb834632a7354ac78f762ee4) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:50.613466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:50.615394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e248-ff47-48a8-ba92-fad5b14b95c8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:50.625617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 270/540] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:50 2022] GET /identity/v3/role_assignments?user.id=482bb28bcb834632a7354ac78f762ee4&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:52.207106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec8e8-e9b7-426c-a8dd-991b6032aad0 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.207661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec8e8-e9b7-426c-a8dd-991b6032aad0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.207661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec8e8-e9b7-426c-a8dd-991b6032aad0 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.209690 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 271/541] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:52.215441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.215923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.216024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.237428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:52.238613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:52.251067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 271/542] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:52.282949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ec8e8-e9b7-426c-a8dd-991b6032aad0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.298689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ec8e8-e9b7-426c-a8dd-991b6032aad0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.306582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.307388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.307659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.307925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.322224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:52.329097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:52.330511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 272/543] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:52.336064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.349614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3290-7abd-4178-9817-6917e06ff39d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.357081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.357751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.358029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.358322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.359115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.359415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.361033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.375698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 272/544] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:52.381187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.393868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17ff34-6fd4-4684-bfdc-73997df0d948 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.400776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.401569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.401848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.402119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.424515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.426431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.446104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:52.447598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 273/545] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:52.453002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.468672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17332f10-cc53-4b5e-b0aa-955496bfd2a8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.476774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.477461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.477734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.478006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.478737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.479036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.480646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.502285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 273/546] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:52.507783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.521803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1a5a1-b9ea-4533-a7dc-0c36519671b2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.528915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.529723 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.529990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.530315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.545973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.548032 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.571829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:44:52.573325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 274/547] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:52.578564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.593991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fb9b-070f-4d22-99f8-c88e41b05428 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.606768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.607526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.607789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.608105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.609049 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.609363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.611322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959337a0-5c26-47e2-a452-45c51d579310 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.634860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 274/548] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:52.640250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.654329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6dab2-abd6-4e5f-b97c-b150263aee81 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.659658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c23d6-91bf-41dc-b12d-05030c5472ad None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.659944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c23d6-91bf-41dc-b12d-05030c5472ad None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.660219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c23d6-91bf-41dc-b12d-05030c5472ad None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.662415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.662621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 275/549] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:52.663252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.663532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.663854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.678568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.678872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.679118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.682948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.687185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.708761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:52.708761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:52.713028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:52.715821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 275/550] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:52.725519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 276/551] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:52.725657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.742184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725292d-5636-4abc-b0e5-2c9f33ec7d97 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.758386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.759074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.759356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.759630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.760381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.760687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.762357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.769761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.782140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ee27-f7cf-42c1-9311-0c7f0d641b2e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.786643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.787444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.787714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.787974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.794224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 276/552] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:52.801503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.803787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:52.811130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:52.812741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 277/553] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:52.818331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.820354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c07-8da6-4cc8-8ada-244170e5afd4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.828845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71de2-524c-4024-8ab9-9fb17c0be1f2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.831122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.832157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.832633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.833280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.833548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.836745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.836745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.836745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.836745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.836745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.837768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.844784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.847004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.847479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 278/554] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:52.852625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.863045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744c35-798d-4a7e-8104-4c8d1894f82b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.867553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.868331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.868656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.868968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.871762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:52.880086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.880607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 277/555] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:52.881906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.887762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.904432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:52.905801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 279/556] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:52.911541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.912862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6422b9-fe97-4555-a2de-d7e46ae2b712 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.921896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d51c-23f4-4ad2-80f0-6d4c860a94ce admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.926477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.927171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.927449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.927715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.928556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.928886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.930654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.933509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.934197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.934474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.934741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.935560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:52.935864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.938624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.943798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 280/557] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:52.949666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.958755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 278/558] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:52.966087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca30f-cf05-4ba0-8526-631cdf1b24cc admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.966284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:52.971351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.972178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.972454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.973009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:52.978808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff1a5-c5aa-423b-bb3f-568173f5245d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:52.983140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:52.984099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe9558-7b82-4d38-8936-2d8ea4717ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:52.985148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9558-7b82-4d38-8936-2d8ea4717ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:52.985490 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9558-7b82-4d38-8936-2d8ea4717ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:52.985605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:52.985845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9558-7b82-4d38-8936-2d8ea4717ce0 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/a5e2802cd72344deb281b227f9acb3a0/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.002419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe9558-7b82-4d38-8936-2d8ea4717ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=a5e2802cd72344deb281b227f9acb3a0, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.002661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d4f687ae-6d7f-457e-aa49-93329f2bd1cd admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 03 02:44:53.004148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 281/559] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.005428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe9558-7b82-4d38-8936-2d8ea4717ce0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.009590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50064c37-0002-4226-9f4b-989d3cafc07f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.010880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50064c37-0002-4226-9f4b-989d3cafc07f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.010880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50064c37-0002-4226-9f4b-989d3cafc07f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.012782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 282/560] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:53.014057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50064c37-0002-4226-9f4b-989d3cafc07f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.031641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 279/561] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:52 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/a5e2802cd72344deb281b227f9acb3a0/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:53.031641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.031641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.031641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.033583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50064c37-0002-4226-9f4b-989d3cafc07f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.051977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:53.054331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:53.162559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.164917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.165229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.165506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.166393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.166700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.168645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.190092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 280/562] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:53.207951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 283/563] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.213875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.224240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe9d7-c9d5-4011-a9e7-4c387ff7cc0e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.225935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.236844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.238045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.238323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.238592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.244259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1df8-aa78-4c7a-a681-c4dc386fa3ad admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.249818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4d7f3-d008-48d5-ba6d-be385b434acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.251142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4d7f3-d008-48d5-ba6d-be385b434acb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.251411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4d7f3-d008-48d5-ba6d-be385b434acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.251686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4d7f3-d008-48d5-ba6d-be385b434acb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.254460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.257007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.265078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4d7f3-d008-48d5-ba6d-be385b434acb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:53.271956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-f3b4d7f3-d008-48d5-ba6d-be385b434acb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:53.273495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 284/564] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.274725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ed0ce-d713-4353-b68f-6b753d79f01f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.275001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ed0ce-d713-4353-b68f-6b753d79f01f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.275269 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ed0ce-d713-4353-b68f-6b753d79f01f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.276557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:53.278034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 281/565] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.279781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 285/566] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:53.285000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.286464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.286750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.287025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.295181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd74d9-ed59-468d-93ef-1969792f8fe1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.299777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.300533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.301450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.301450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.302011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.302312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.304060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.307591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:53.308897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:53.315403 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 282/567] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:53.316459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.322015 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 286/568] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:53.324814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.327462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a150e-6c84-4afe-bac1-7eb31645460f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.332494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5749a-19c3-4df2-b93d-45922649b1ed None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.333642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.334578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.334993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.335481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.336578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.337050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.337339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.338188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.338537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.338873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.339634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.350063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.352038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.355637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 283/569] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.356637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.374869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a2f9c-33a7-461c-9c7a-d2218aa06306 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.376910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:53.379731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b9b0-30dd-4c70-a31e-8024f57da063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.380085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 287/570] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.380933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b9b0-30dd-4c70-a31e-8024f57da063 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.381045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.381566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b9b0-30dd-4c70-a31e-8024f57da063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.382077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b9b0-30dd-4c70-a31e-8024f57da063 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.390707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21201c-2088-439e-8fdc-be3897a092ae admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.393213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b9b0-30dd-4c70-a31e-8024f57da063 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:53.395183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.395937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.396221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.396494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.401572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-0c32b9b0-30dd-4c70-a31e-8024f57da063 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:53.403001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 284/571] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.403445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.404514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5369b-2879-4a75-aeb2-0d3c35f9f857 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.404951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5369b-2879-4a75-aeb2-0d3c35f9f857 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.405448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5369b-2879-4a75-aeb2-0d3c35f9f857 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.407309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 285/572] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:53.408136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5369b-2879-4a75-aeb2-0d3c35f9f857 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.409835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.422181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5369b-2879-4a75-aeb2-0d3c35f9f857 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.425227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:53.426418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.426798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 288/573] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.431227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.431227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.431438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.431539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.431539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.431539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.431539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350d271-3471-4ec6-b2cb-e5dc53fdcf62 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.441679 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ed09-8a0d-445f-87ca-772ae50e2930 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.442674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 286/574] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.443919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.444198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.444467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.450148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.450814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.451284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.451568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.453252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.453561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.455185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.463422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:53.464575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 289/575] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.464673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:53.465838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.473623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 287/576] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:53.474254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.477456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f412-9751-4c93-8ed0-9c773246ddfb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.484414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.485208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.485780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.486156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.487961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.488375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.490626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.491439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326f4b-779d-41b1-9753-bce9b20353a2 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.496521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.497510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.497786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.498558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.504204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 290/577] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.505363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.506813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.508871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.515323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff66a3-bc3f-4c15-9e36-5c57a74502ee admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.519743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.520531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.520829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.521096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.523067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 03 02:44:53.529163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 288/578] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.529163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.534003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.534219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f2617-b2d5-43e8-b31e-fc5aeb23a41c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.536141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.538594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.539333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.539641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.539876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.549994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:53.553965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:53.559836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 291/579] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.559836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.560008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:53.560008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 289/580] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.560008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.569635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eef5d-938e-4c2d-96e9-c907b2bb02d2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.570246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c946d4-49d7-4953-b5f4-622cccacc5f4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.574179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.574589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.575033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.575211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.575305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.575496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.575600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/3a83aa4460fb48469b62d1069358ec73/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.575765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.576592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.576927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.578817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.591953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=3a83aa4460fb48469b62d1069358ec73, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.595437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.600464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 290/581] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.600464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.609680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1db45-5dbd-404c-b936-cebe3decf95b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.612935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 292/582] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:53 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/3a83aa4460fb48469b62d1069358ec73/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:53.617670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.693605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befec05-3c93-4ad2-83e8-324496291705 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.695480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.696313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.696639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.697016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.697846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.698367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.700093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.700547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.701439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.701919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.702496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.703511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.703994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.705858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.718574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 291/583] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.718574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.718828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 293/584] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.724493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.731267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b03fa-f6cd-4032-9575-8450f5159e68 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.736680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.737232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b22c-75fa-439d-803f-3e64d4ee2ef2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.738433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.739092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.739678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.741812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.742615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.742895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.743361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.751377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.753639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.756232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.758629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.768443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 03 02:44:53.774035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 294/585] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.774035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.783182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:53.784335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061d4c7-a853-4328-a1cf-d7330b4cb523 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.784905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 292/586] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.789570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.795814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.796633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.796941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.797212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.801171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76e65-fed1-4d40-99c7-b543feb2e61e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.807014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.807916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.808191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.808554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.809010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.810018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.810118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.810589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.812616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.827303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:53.830303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 295/587] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.830303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.832099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 293/588] 10.222.0.31 () {56 vars in 1160 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.834760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.839371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fc8c-ca4b-4088-8c72-32c4ac412b58 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.843771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.844440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.844733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.844994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.845724 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.846028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.847664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.848540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411574e-5a38-4101-944f-9f1dcd6598db admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.856349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.857281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.857553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.857833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.858627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.858928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.860233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 296/589] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.860511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.861507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.873761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 294/590] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:53.873761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.879585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c35b4-58a8-4755-80c5-71125334324f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.885752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe21e-92b6-4d6c-894f-46d42e46bf9a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.892310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.893140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.893414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.893684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.894058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.895217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.895907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.896341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.902715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.904686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.914106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.915994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.923358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:53.925428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 295/591] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.926388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.935963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51711a-c717-4318-ac53-3991a04b38a0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.937237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:53.939029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 297/592] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.941627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.944399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.945154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.945433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.945687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.954632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.954847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59e16-9fcf-447b-94d3-ca9a9108031d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.957061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.959804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:53.960667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:53.961115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:53.961536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:53.962531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:53.962974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:53.965171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:53.972099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 03 02:44:53.974091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 296/593] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:53.974876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.983533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 298/594] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:53.988888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:53.994433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f6dad-55e3-47c9-a943-e4ec8d139892 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.998606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3a6e-d826-486e-90d1-f610c4abe033 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:53.999401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.000284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.000776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.001300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.002385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:54.002875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.003862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.004511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.004804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.005088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.005514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.005956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:54.006256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.008309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.018331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 297/595] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:54.023669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.029202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 299/596] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 3 02:44:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:54.029954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.039133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad49cc-b390-491a-9c39-7ffb7a4c99dd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.044600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.045572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.045891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.046043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be282-6a20-44c8-ae44-40965c5e813c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.046184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/30865d753bcb4542bee3b1c86a14b51e/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.050797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.051757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.052184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.052600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.059993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.062375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.062737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=30865d753bcb4542bee3b1c86a14b51e, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.065884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.078503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:54.079963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 300/597] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:54.080920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.094207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 298/598] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:54 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/30865d753bcb4542bee3b1c86a14b51e/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:54.099521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7458-b41a-42be-b676-8c3447c19f08 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.100789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.163578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.164292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.166141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.166423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.185897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.191081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.213591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 301/599] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:54.219199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.229677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d589-d183-4f8b-9a27-caf7fa54f635 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.235492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b49979-6376-4d80-b913-757674bb1e77 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.238544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.239234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.239502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.239767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.242640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:54.243493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.247185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.247991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.248501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.249270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.250938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.267924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 299/600] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:54.274771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.277962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.279931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.285728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319447f7-cefe-4e74-812f-56c67254e7b8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.291309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.292283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.292611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.292916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/482bb28bcb834632a7354ac78f762ee4/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.311061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=482bb28bcb834632a7354ac78f762ee4, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.312707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:54.314131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.323558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 302/601] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:54.329100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.334841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 300/602] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:54 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/482bb28bcb834632a7354ac78f762ee4/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:54.346708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9975-f18f-4b3f-aba2-bfe0282e8922 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.412162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.413102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.413478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.413901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.414805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:54.415216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.417016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.430339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 303/603] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:54.435843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.453896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff2b6-5b61-466c-b118-9d2e0b156282 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.465243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.465977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.466251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.466520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.482188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.484537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.508574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:54.510177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 301/604] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:54.516150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.531079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d0f4-8ba8-4e31-a0bd-e69d5d6ce62c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.541486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.542383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.542761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.543133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.544109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:54.544518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.546764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994110-0068-428e-aef9-de6ad851109f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.566996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 304/605] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:54.573132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:54.584988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce6cc-6c39-462c-8dbf-be0e6f6a503b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:54.589438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:54.590145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:54.590410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:54.590735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:54.591602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=8951b6805c1d4f619c6fc26249eda16f) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:54.591955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:54.594020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bcddd-365e-45b8-acec-70cba4f35361 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:54.600372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 302/606] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:54 2022] GET /identity/v3/role_assignments?user.id=8951b6805c1d4f619c6fc26249eda16f&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:55.553918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1c94-595b-4e22-a457-9d55ecc8aa9b None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.554520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1c94-595b-4e22-a457-9d55ecc8aa9b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.554520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1c94-595b-4e22-a457-9d55ecc8aa9b None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.556481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 305/607] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:55.562025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.562535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.562535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.584636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:55.585840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:55.598776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 303/608] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:55.639321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1c94-595b-4e22-a457-9d55ecc8aa9b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.651871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1c94-595b-4e22-a457-9d55ecc8aa9b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.656281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:55.661467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.661793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.662002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.674448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:55.681309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:55.682857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 306/609] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:55.688777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.701709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df9174-fa8a-443d-9389-3b6938f07bac None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.708767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:55.709450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.709722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.709992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.710760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:55.711061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:55.712670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:55.726184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 304/610] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:55.731728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.742126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722d0a-2b92-43ee-b9d2-3fcc9e2b29ee admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.751437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:55.752291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.752568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.752867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.771142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:55.773012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:55.792891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:55.794433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 307/611] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:55.799854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.813914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0a9b8-e22a-45af-a2b7-4d4c3246f881 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.820752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:55.821426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.821703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.821975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.822720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:55.823022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:55.824643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:55.843894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 305/612] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:55.849391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.859505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7e924-f372-413f-bbf7-fce9dfb49fea admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.871860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:55.872653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.872953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.873221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.881645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:55.883649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:55.901156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:44:55.907705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 308/613] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:55.913211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.929662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb816e8-1aea-4780-8623-517c129e786e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.938498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:55.939171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:55.939448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:55.939716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:55.940564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:55.940898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:55.942743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:55.975352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 306/614] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:55.981081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:55.991952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c29bd-201b-4167-9ae1-c3dfddb52540 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:55.996397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.001255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.001545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.001789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.011053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.012884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.029348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 309/615] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:44:56.035306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.049782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e5e6-0308-417d-b8db-0523a7dd3910 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.054279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.055071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.055388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.055606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.079037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.085650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.108358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:56.109579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 307/616] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:56.115617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.124771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf2089-86fb-4887-9030-dbeae9212d7a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.129143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.129787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.130068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.130321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.131049 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.131344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.137010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.149513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 310/617] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.155408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.169516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2933b8e-679a-4416-b0cd-e555242d1312 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.173912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.174695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.174969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.175239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.185881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.187859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.204030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:56.205549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 308/618] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:56.211125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.220968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773a2d-eb41-44cf-8cdb-ff48902c3ac8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.225280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.225920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.226193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.226456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.227247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.227541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.233529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572ad9b-d565-4146-a7fd-dce520b09f6a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.245824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 311/619] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.251861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.265814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2072be-7be2-41c8-aa47-ede3dfd8072c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.270190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.270829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.271101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.271371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.272208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=a5e2802cd72344deb281b227f9acb3a0) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.272510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.274364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa7c6b-1308-46fe-8127-a18ecf3fcf25 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.285232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 309/620] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/role_assignments?user.id=a5e2802cd72344deb281b227f9acb3a0&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.316893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e0b97-c4c0-4ae7-a3f5-bc6b4017c012 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.316893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e0b97-c4c0-4ae7-a3f5-bc6b4017c012 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.316893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e0b97-c4c0-4ae7-a3f5-bc6b4017c012 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.316893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 312/621] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:56.323505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.323831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.324026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.349256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:56.350373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:56.363497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 310/622] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:56.400208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e0b97-c4c0-4ae7-a3f5-bc6b4017c012 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.416421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e0b97-c4c0-4ae7-a3f5-bc6b4017c012 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.422414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.423215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.423530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.423793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.440783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:56.447945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:56.449758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 313/623] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:56.455769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.470362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e051756-f196-441d-824e-6dcfb7bec201 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.480647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.481365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.481634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.481903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.482701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.482999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.484674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.500603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 311/624] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.506766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.521981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7eef-c7ca-4d20-9259-06b99ed6160e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.528454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.529269 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.529542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.529822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.543640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.545929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.566979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:56.569454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 314/625] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:56.575400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.586977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4b99-e88b-4c9e-992c-95f542c82097 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.593702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.594843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.595317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.595820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.596840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.597343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.599349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.613299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 312/626] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.625253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.636373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11977569-675f-4e54-9d35-db27ef3b5e6c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.643745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.644787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.645205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.645636 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.657026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.659377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.679496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 03 02:44:56.681314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 315/627] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:56.687194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.700087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2830ae-224f-4f88-81f6-a7d3956186bf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.707760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.708649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.709111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.709610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.710659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.711109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.713239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.738170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 313/628] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.744016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.755089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df31a5-6080-4979-8499-c534f494aeb7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.762163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249f3e6-a784-4b47-80ff-e7f5080b26d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.763045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249f3e6-a784-4b47-80ff-e7f5080b26d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.763467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249f3e6-a784-4b47-80ff-e7f5080b26d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.763945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249f3e6-a784-4b47-80ff-e7f5080b26d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.776595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249f3e6-a784-4b47-80ff-e7f5080b26d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.778656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249f3e6-a784-4b47-80ff-e7f5080b26d8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.790732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 316/629] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:44:56.795986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.808278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b63b8-c990-4a23-8a03-1462915240fa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.816143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.816976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.817302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.817571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.832467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.834389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.841478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c7a40-2484-4f50-ad84-54ceaaeb0496 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.841760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c7a40-2484-4f50-ad84-54ceaaeb0496 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.842025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c7a40-2484-4f50-ad84-54ceaaeb0496 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.843895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 317/630] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:56.849237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.849577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.849788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.864327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:56.865576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 314/631] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:56.880562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:56.881452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.881785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:56.896861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 318/632] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:56.899272 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909314f-5b8a-44cf-aaad-ab4d09ec33e8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.911674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.912339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.912616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.912910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.913653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:56.913954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.915548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:56.920234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.934526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269580-f1b5-4c09-be5b-66d036745331 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.940889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 315/633] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:56.948799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:56.953204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.954505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.954928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.955442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.957217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829d18a-e524-41fc-b386-c8f0c8bdcd56 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:56.965319 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:56.966132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:56.966415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:56.966682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:56.979597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:56.986520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:56.988343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 319/634] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:56.988982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:56.991006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.001702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.008353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:57.010098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 316/635] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.013870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000037-8a42-4b55-9c35-67f652197808 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.015305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.029299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.030265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.030723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.031126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.032108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46222f-b0ab-4537-981f-78339e3fefc6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.032490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.032948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.036209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.044109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.045081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.045515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.045964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.046927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.047615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.051080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.062583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 320/636] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.073678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 317/637] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:57.075384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.081950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.091308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4796-c76e-49d7-b392-56ce6494d4e0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.100489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.101606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.102021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.102422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.107734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516d7d-33ef-4fec-be59-e970bafa058b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.119013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.119865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.120276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.120677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.121713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=3a83aa4460fb48469b62d1069358ec73) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.122974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.123290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.126670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.127921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.142944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 318/638] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/role_assignments?user.id=3a83aa4460fb48469b62d1069358ec73&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.150680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:57.156985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 321/639] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.158666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.170474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db814ca2-b445-4bef-8d0b-df80be6677d8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.175439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.176402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.176901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.177308 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.178245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.178722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.180645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.198851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 319/640] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.200643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.211327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24c07d-26ac-4a72-b4fe-90d17af640a0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.216213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.217253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.217833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.218239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.226474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.228796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.245265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 03 02:44:57.250676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 322/641] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.253231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.263629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebf168-face-43a6-b634-c801a8bf30f7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.268828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.269759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.270221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.270748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.271829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.272313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.274383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659db6f-d8cf-46b9-80aa-e31d7e613765 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.294434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 320/642] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.300449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.310497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc974-7153-493b-825e-954877c30bfa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.315316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad1543-1001-474b-8485-6b4e6004b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.316020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad1543-1001-474b-8485-6b4e6004b9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.316292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad1543-1001-474b-8485-6b4e6004b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.316564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad1543-1001-474b-8485-6b4e6004b9ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.325979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad1543-1001-474b-8485-6b4e6004b9ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.327914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad1543-1001-474b-8485-6b4e6004b9ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.333353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444453f-d2d4-4579-a7e0-a59250858202 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.333626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444453f-d2d4-4579-a7e0-a59250858202 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.333901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444453f-d2d4-4579-a7e0-a59250858202 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.335812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 321/643] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:44:57.336887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcd224-f6b9-4af5-8d0c-62d54f07ae7d None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.337160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcd224-f6b9-4af5-8d0c-62d54f07ae7d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.337430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcd224-f6b9-4af5-8d0c-62d54f07ae7d None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.339384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 322/644] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:57.342382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 323/645] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:57.346182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.346421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.346514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.346693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.346779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.346999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.368978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:57.369931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:57.370202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:57.371116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:57.378698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 323/646] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:57.379576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.385253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 324/647] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:44:57.389349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b3947-cb5d-4fb1-8e5f-465214a2544f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.394040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.394850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.395123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.395390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.407249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.409161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.415191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.426936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:57.429259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 324/648] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.432540 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d90c3a-d161-4d24-bb9a-137546dbd8c2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.434522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.439993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.440967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.441349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.441691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.445391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6906b-bbf2-42fe-8b4c-060f8f8e190a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.449836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.450508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.450767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.451035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.451777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.452151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.453327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:57.453803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.461779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:57.464196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 325/649] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:57.465271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.470674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 325/650] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:57.470674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.480567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf2b19-b5df-47ac-8cdb-51c15ef668a1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.481318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0b8fd-a768-478e-9ad8-4cdbd022a9b8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.487814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.488610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.488952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.489230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.490003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.490726 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.491075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.491413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.492242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.492609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.494930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.502362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:57.505502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 326/651] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:57.507765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.517539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773f2d-d937-42e2-bdec-981da1363c84 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.518931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:44:57.520547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 326/652] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.521288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.528426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.529849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.530243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.530619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.531916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cac938-94c9-48c2-84c7-c1c6082968fa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.536743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.537559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.537834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.538107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.539897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.542504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.550647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.552507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.558405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:57.560222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 327/653] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.561656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.570781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:57.572490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 327/654] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.572662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd9fe8-1d9e-4e72-adcc-911232bae2ef admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.573676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.580217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.581399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.581813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.582236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.583144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.583446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.585092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.587192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731669-a4c7-41a1-81bc-63e455231edb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.592857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.593619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.594008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.594379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.594852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 328/655] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.595179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.595484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.595575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.597368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.611456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 328/656] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.612384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b0d6-515d-4639-bff0-7c3ae22e2a56 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.612630 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.620346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.621556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.622053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.623313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.624605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.625220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.626473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee6a3-72b0-4fcc-a579-093c43dec92f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.627609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.631829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.632620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.632960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.633233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.642352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 329/657] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.647071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.649901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.652085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.656676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109491f-d2bd-4ed7-a90b-7eee7bef8637 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.661346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.662019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.662296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.662565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.663402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=30865d753bcb4542bee3b1c86a14b51e) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.663709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.665590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.672115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 330/658] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/role_assignments?user.id=30865d753bcb4542bee3b1c86a14b51e&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.673001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.674255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:57.676078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 329/659] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.687527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4155-c3c4-4afd-9f56-a73f0c17e1d6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.689847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.692683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.693564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.693843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.694118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.702800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705d64-67bd-4550-a7e6-7df2155fb013 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.702987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.705005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.708392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.709443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.709951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.710435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.711394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.711925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.713807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.719841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 03 02:44:57.721120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 331/660] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.730264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.733414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 330/661] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.742070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.747105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4fd5-a78f-43a8-b53b-300556f7c151 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.760275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.760997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.761278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.761468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b21310-104c-4a1d-b719-7bcc379bb96c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.762407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.764234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.764633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.768517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.772275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.773266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.773546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.773822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.797369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.799558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.816330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 332/662] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.822411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.830218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 03 02:44:57.831701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 331/663] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:57.837336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.847237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad30df3-7f07-48b8-aef5-40cb1f452880 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.848380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136300b-83f5-4893-bcbc-1b5d352bd5b3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.853109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.853832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.854108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.854426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.855297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.855647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.857700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.869823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.870417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.870642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.870913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.879130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 332/664] 10.222.0.31 () {56 vars in 1160 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:57.885097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.893949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.895840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.896839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef717b-7032-484a-93c3-368693e7266e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.902327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.902327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.902720 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.903102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.914854 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.916884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.922934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:57.924499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 333/665] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:57.927216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 333/666] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:57.929659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.942367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.944399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e248a-f8eb-4a8e-b3ca-59fe2ad59110 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.950236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.950992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.951366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.951704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.952545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:57.952941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.953314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4156d0-3473-4bc8-a71e-38c47265ed99 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.954804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.959958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.961032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.961482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.961919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.968170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 334/667] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:57.973413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:57.975525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:57.977604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:57.984238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28b59b-153b-4586-8be6-e10d7127ef8b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:57.989650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:57.990426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:57.990814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:57.991157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:57.998409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:57.999357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.000521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 334/668] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:58.004768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.006208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:58.017241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40582ab-2ea4-4b0b-ba59-f610e6d42c3c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:58.021848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:58.022590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.022962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.023333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.024161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:58.024578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.024918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:58.026408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.027373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 335/669] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:58.033064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:58.043021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6887f-1c6b-4c8b-873b-a72507499f18 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:58.045838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 335/670] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:58.047092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:58.048541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:58.049425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.049867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.050271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.051252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:58.051735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.053804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.058023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127179b3-9331-47c3-815e-a2723f0af136 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:58.063296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:58.064622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.065057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.065427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.068395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 336/671] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:44:58.073125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.074396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:58.075308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.084792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f9028-1447-408d-9b12-a45ea8ee43a8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:58.090200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:58.090622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:58.091522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.092183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 336/672] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:44:58.092427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.092939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/8951b6805c1d4f619c6fc26249eda16f/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.098757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:58.109682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=8951b6805c1d4f619c6fc26249eda16f, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.110044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ce960-185a-4ac8-9859-ab270930626a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:58.113780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.115109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:58.115855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.116229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.116596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.117737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:58.118534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.121671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03274157-9376-4f8e-8088-76f46ef98b1f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.133775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 337/673] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:44:58 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/8951b6805c1d4f619c6fc26249eda16f/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:44:58.138112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 337/674] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:58.144200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:58.235186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311592a-7350-4b7c-bd58-b55516fd5b96 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:58.246303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:58.247064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.247340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.247654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.248539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=482bb28bcb834632a7354ac78f762ee4) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:58.248970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:58.250874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7c1c5-96e9-4b13-9846-fe5f2954c50a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:58.262240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 338/675] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:58 2022] GET /identity/v3/role_assignments?user.id=482bb28bcb834632a7354ac78f762ee4&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:58.981749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936bc7c-af27-4059-8ba2-9138fceb6e73 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.982278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936bc7c-af27-4059-8ba2-9138fceb6e73 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.982278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936bc7c-af27-4059-8ba2-9138fceb6e73 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:58.984308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 338/676] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:44:58.990197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:58.991015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:58.991481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.009729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:44:59.011268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:44:59.019565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 339/677] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:44:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:44:59.043181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936bc7c-af27-4059-8ba2-9138fceb6e73 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.055907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936bc7c-af27-4059-8ba2-9138fceb6e73 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.060478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.061562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.062053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.062531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.074311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:44:59.081387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:44:59.083207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 339/678] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:59.089438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.098929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e64f5-2889-45bf-ab86-2e33a4828c94 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.103777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.104679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.105215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.105696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.106649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:59.107139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.109039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.118557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 340/679] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:59.124299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.134414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b59e2-3a93-4a85-b9bf-15654c8fcbb8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.139333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.140432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.140958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.141439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.158903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.161100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.182460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:59.184086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 340/680] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:59.189915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.203144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4ef1-0217-4513-8180-f2215e852e8e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.209928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.210962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.211443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.211960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.212919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:59.213469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.215388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.230005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 341/681] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:59.235623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.250620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7409e6-fced-4082-b075-275587e953e2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.257996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.259128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.259619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.260118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.270676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.273120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.291817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:44:59.297364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 341/682] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:59.302920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.316823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c41a3-9633-4e1c-9842-78652a425180 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.321278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.321942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.322217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.322488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.323349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:59.323651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.329704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.360469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 342/683] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:59.366378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.382684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d512-6e7a-4998-a035-32aa8a35d6ed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.389482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.390637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.391121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.391657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.405891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.408084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.423657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 342/684] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:44:59.428906 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.450909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac0ca-6a1f-46d9-81aa-25dec8b50ec9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.458688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.459488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.459765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.460042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.480998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.482996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.508957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:44:59.513071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 343/685] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:59.514595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.524045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926c54-0b37-4e06-9164-8cae4235f96a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.540284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.541169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.541551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.541921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.542783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:59.543221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.544947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.562462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 343/686] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:59.567801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.585875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c7b81-b5e5-4757-85d4-3eb3274bddcf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.598246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.599051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.599328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.599596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.617923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.619914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.636349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:44:59.637886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 344/687] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:44:59.643501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.655194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a09232-c593-4013-b693-f6de6e0b4c8e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.666880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.667730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.668179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.668567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.669566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:59.669975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.672050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d15db2-37cc-4b0e-a6fa-867cf81bb0ea admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.692929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 344/688] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:44:59.698572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:44:59.723132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a23c-d307-42ff-8529-d876ff186d7a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:44:59.737682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:44:59.738351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:44:59.738624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:44:59.738891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:44:59.739736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=a5e2802cd72344deb281b227f9acb3a0) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:44:59.740043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:44:59.741998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be1865-c7d5-4491-b2b8-8db9b2cc765e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:44:59.748214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 345/689] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:44:59 2022] GET /identity/v3/role_assignments?user.id=a5e2802cd72344deb281b227f9acb3a0&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:00.074797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34c06-09c8-450e-ac29-074b26258cc7 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.075318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34c06-09c8-450e-ac29-074b26258cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.075318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34c06-09c8-450e-ac29-074b26258cc7 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.077504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 345/690] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:00.082865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.083316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.083536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.104963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:00.106140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:00.114471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 346/691] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:45:00.150803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34c06-09c8-450e-ac29-074b26258cc7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:00.166250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34c06-09c8-450e-ac29-074b26258cc7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:00.170729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:00.171524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.171796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.172061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.189012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:00.190845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:00.219025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:00.220469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 346/692] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:00.225971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:00.235077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207c94-ff11-409b-9abc-0e31feb8ab6c None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:00.244708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:00.245399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.245675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.245943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.246685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:00.246985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:00.248580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1892d0f-7fc9-451d-b0fb-13fdff8da192 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:00.260619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 347/693] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:00.265778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:00.275943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb4cc1-e893-4c72-a7d0-6008954f6dad admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:00.280727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e47d1a-e2a5-483c-bfe3-9327f8a7aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:00.281421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e47d1a-e2a5-483c-bfe3-9327f8a7aafa admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.281745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e47d1a-e2a5-483c-bfe3-9327f8a7aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.282012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e47d1a-e2a5-483c-bfe3-9327f8a7aafa admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.282725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e47d1a-e2a5-483c-bfe3-9327f8a7aafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:00.284805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e47d1a-e2a5-483c-bfe3-9327f8a7aafa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:00.312444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 347/694] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:45:00 2022] POST /identity/v3/users => generated 254 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:45:00.648627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493f5b-4855-4008-a297-8959fab5bd4d None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.649060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493f5b-4855-4008-a297-8959fab5bd4d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.649238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493f5b-4855-4008-a297-8959fab5bd4d None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.651290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 348/695] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:00.656681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.656994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.657277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.679562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:00.680798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:00.692844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 348/696] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:45:00.714273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493f5b-4855-4008-a297-8959fab5bd4d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:00.726703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493f5b-4855-4008-a297-8959fab5bd4d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:00.732282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:00.733221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.733508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.733781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.734465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:00.735496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:00.735496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:45:00.735496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:45:00.736402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:00.753819 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 03 02:45:00.755368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 349/697] 10.222.0.31 () {56 vars in 1150 bytes} [Thu Feb 3 02:45:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:00.760900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:00.770336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4df31-6ad6-4951-8291-d453f983ed3f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:00.775800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:00.776607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.777027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.777403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.778235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:00.778645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:00.779780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:00.779780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:45:00.779780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:45:00.781002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3ad76-40fc-40a6-94bf-8c86e9dcf000 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:00.788110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 349/698] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 3 02:45:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:00.793253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:00.807038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea324bc-0a03-429e-9afa-8ff974e61007 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:00.813817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:00.814477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.814753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.815020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.815737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:00.816036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:00.817072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:00.817072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:45:00.817072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:45:00.817946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170e0e0-2346-46a1-8c28-df980bfa3a6f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:00.829882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 350/699] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 3 02:45:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:00.956802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14237376-2cba-4a3f-8447-93dd18255c26 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.956802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14237376-2cba-4a3f-8447-93dd18255c26 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.956802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14237376-2cba-4a3f-8447-93dd18255c26 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.957424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 350/700] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:00.963454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:00.963733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:00.964003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:00.986618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:00.988190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:00.999051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 351/701] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:45:01.034284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14237376-2cba-4a3f-8447-93dd18255c26 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.047689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14237376-2cba-4a3f-8447-93dd18255c26 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.052370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.053448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.053876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.054281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.066493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:01.073836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:45:01.080197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 351/702] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:01.082205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.091784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c325c11-918d-470a-befc-8c5e08a5e520 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.097031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.097890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.098480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.098890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.099797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.100236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.102048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c554b-33b7-49e0-a976-1cfa45618685 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.111004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 352/703] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:01.117111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.127110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e2f3-1f41-459e-9351-8986851102ae admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.131676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.132645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.133085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.133495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.144978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.147089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.152101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a82c-a25e-4d06-89ed-f34d5718cb9c None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.152561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a82c-a25e-4d06-89ed-f34d5718cb9c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.153072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a82c-a25e-4d06-89ed-f34d5718cb9c None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.155489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 353/704] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:01.162464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.163026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.163500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.166752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:01.168289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 352/705] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:01.174611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.186656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23f151-959e-4b32-bf9e-91a541b27bfb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.191537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:01.192747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:01.193084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.194107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.194629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.195181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.196243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.196848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.199527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.204747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 354/706] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:45:01.216772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 353/707] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:01.222255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.229235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.233568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32afd46-81ef-4a9d-bead-81c55e1c4c85 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.238585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.239375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.239696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.240181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.254487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca9db-2160-4e82-869a-2d2dbb3c2776 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.264263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.266666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.266996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.268182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.268732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.270469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.271327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.273295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:01.273295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:45:01.273295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:45:01.274573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.300318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 03 02:45:01.302606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 03 02:45:01.304710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 354/708] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/services/network => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:01.305596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 355/709] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:01.311079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.321367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15a51b-7990-480f-8d72-7b88b0fa1c50 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.324253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.335850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1954-c10b-493d-a99b-9010fe5a43a9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.339698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.342289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.343198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.344573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.345765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.347214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.348067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.350277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.351188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.351664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.352137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.353252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.355759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.357654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.371352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 355/710] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:01.385340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 356/711] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:01.386672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.390528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.400126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2282df-bb02-479a-88b5-5741fad80973 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.409861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bce9b-b338-426b-8191-c9c6b695f6bb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.411893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.412565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.412871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.413142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.413865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.414167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.415781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.424830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 356/712] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:01.425430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.426086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.426364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.426666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.435442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.437309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.447420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 357/713] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:45:01.453336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.463657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd7c6c-1bed-4a36-82a1-55b6c69bff69 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.468374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.469154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.469436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.469709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.489173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.491121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.516604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:01.518292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 357/714] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:01.523605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.538273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf17fb-3ad3-4e63-8f01-346d7ae11bc8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.549314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.549991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.550270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.550548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.551299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.551610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.553250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.578547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 358/715] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:01.583981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.598161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bab6-c265-4338-a7c9-e9013b856633 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.614135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.614959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.615233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.615497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.626032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.628062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.648297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:01.649912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 358/716] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:01.655309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.673878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027c18-314f-4ee9-aae5-6587bfd83e95 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.680787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.681458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.681743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.682012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.682826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.683132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.685019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d5c39-1546-4227-8a2d-1978a4519635 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.705748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 359/717] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:01.711608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:01.725897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36eab1-e071-483f-8624-79e23a3d9fed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:01.730295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:01.730992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:01.731268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:01.731583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:01.732419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=8951b6805c1d4f619c6fc26249eda16f) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:01.732751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:01.734723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101301ca-587b-4d9f-acb3-41bc9d538f47 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:01.741842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 359/718] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:01 2022] GET /identity/v3/role_assignments?user.id=8951b6805c1d4f619c6fc26249eda16f&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:02.546812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1071-24c0-485b-9120-50450a07bc1f None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.547523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1071-24c0-485b-9120-50450a07bc1f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.547523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1071-24c0-485b-9120-50450a07bc1f None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.549462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 360/719] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:02.554864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.555385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.555560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.575876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:02.577155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:02.595252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 360/720] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 03 02:45:02.634537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1071-24c0-485b-9120-50450a07bc1f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:02.650680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1071-24c0-485b-9120-50450a07bc1f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:02.658818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:02.659629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.659907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.660176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.674727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:02.681541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:02.682754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 361/721] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:02.688590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:02.697867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fca0b-98ea-449c-8be7-49b1f27df200 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:02.708978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:02.709662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.709940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.710213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.710996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:02.711297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:02.712944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:02.730124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:02.730551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 361/722] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:02.745868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198a35a-a5df-40dc-9c3f-8eab8b036c30 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:02.754211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:02.755004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.755282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.755552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.772671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:02.774574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:02.794976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:02.796352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 362/723] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:02.802461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:02.813026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a949-ccc4-43b0-9b60-36641ef8c755 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:02.827253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:02.827991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.828272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.828545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.829335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:02.829641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:02.831281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:02.848434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 362/724] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:02.853882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:02.870024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6623d-c59e-45c0-8de2-6d51a32f6e26 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:02.879128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:02.879962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.880243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.880517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.894061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:02.896114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:02.912274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:45:02.913830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 363/725] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:02.919081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:02.934480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ecbd6-68c7-427c-b290-162745b33721 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:02.949979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:02.951722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:02.952037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:02.952318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:02.953747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:02.954054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:02.957332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb9ea-bcb6-449e-b981-08bbc57f5711 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:02.991489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 363/726] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:02.996633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.015102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbb2f-6eeb-4492-afb4-0575f56200c3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.029373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.030246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.030521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.030780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.044913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.046961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.086664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:03.088202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 364/727] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:03.090528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc4d6-e88c-4393-920d-1a6b010f9870 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.090816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc4d6-e88c-4393-920d-1a6b010f9870 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.091093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc4d6-e88c-4393-920d-1a6b010f9870 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.093346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 364/728] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:03.099690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.099973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.100252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.102017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.122205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5b393-4eb3-40ab-b8da-f65c5c223577 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.131235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.131894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.132172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.132445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.133224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.133531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.135142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.137245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:03.138430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:03.150958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 365/729] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:03.156455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.161613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 365/730] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:45:03.166548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5047-ace8-4e80-bcae-12ce8b1d6333 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.171240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.172058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.172336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.172637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.179865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.182036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.195255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:03.196798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 366/731] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:03.202440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.212315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33311-81b0-4fde-adcf-1db927002f54 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.213735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.225500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abffc7f-8d2c-4631-8a63-424a764ae915 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.229995 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.231176 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.232805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.233168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.233987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.234627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.235404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.235927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.237256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.237574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.239422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.259859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:03.263307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 366/732] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:03.273223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:45:03.274684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 367/733] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:03.278485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.284848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.293281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033bf33-831d-4002-8ef5-e0078e0c4009 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.301856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee31381-d606-494d-98a1-f4a61dc1a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.304097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee31381-d606-494d-98a1-f4a61dc1a477 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.304381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee31381-d606-494d-98a1-f4a61dc1a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.304655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee31381-d606-494d-98a1-f4a61dc1a477 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/a5e2802cd72344deb281b227f9acb3a0/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.305687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141b7b-1c85-4dbc-a374-bff2620b3b2a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.309101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee31381-d606-494d-98a1-f4a61dc1a477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=a5e2802cd72344deb281b227f9acb3a0, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.314454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.315168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.315442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.316168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee31381-d606-494d-98a1-f4a61dc1a477 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.316969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.318155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.318466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.321727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312675b-44d2-4636-ae7e-b75f90320dc5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.335297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 368/734] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:03.336743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc6dcf-d142-498f-b98c-61eea106f4d8 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.337074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc6dcf-d142-498f-b98c-61eea106f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.337461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc6dcf-d142-498f-b98c-61eea106f4d8 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.339233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 367/735] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:03 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/a5e2802cd72344deb281b227f9acb3a0/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:45:03.339346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 369/736] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:03.344320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc6dcf-d142-498f-b98c-61eea106f4d8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.345402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.345795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.346342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.378782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:03.380015 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:03.435790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc6dcf-d142-498f-b98c-61eea106f4d8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.444639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.445553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.445827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.446131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.469372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.471321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.504504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:03.507344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 368/737] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 03 02:45:03.513004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 370/738] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:03.515509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.528731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cdd23-76d1-47dc-ac3b-64cbb0ac7b23 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.534660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.535337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.535665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.535937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.536763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.537124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.538876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.554550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.556000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 369/739] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:03.564640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.566927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb82777-f178-4818-bb91-734fafcac7f5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.574173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.574835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.575115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.575311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67a4f-8f2f-4e99-8114-435afdb1b11d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.575391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.576130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.577367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:03.577367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:45:03.577367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:45:03.578240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.580070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.581125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.581406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.581681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.591130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.593169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.597266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 371/740] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:03 2022] POST /identity/v3/services => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:03.607697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 03 02:45:03.609348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 370/741] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:03.615391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.651338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082073-c55c-46a1-98ea-305eac1fcee4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.656746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.657497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.657779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.658098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.659032 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.659347 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.661379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.687180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 372/742] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:03.692478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.709353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa5e12-96ae-4a9b-ad5a-7f9e5885a2c8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.717993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.718716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.719000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.719272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.732705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.734659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.748906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 371/743] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:03.754464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.770703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3038434-8e61-4b6a-8603-13f4e0ff6402 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.775591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.776414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.776692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.776994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.792543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.794539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.820500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:03.822199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 373/744] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:03.827624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.844894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398985f6-ef8f-4c63-b257-12855fba0b7a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.854186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.854866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.855147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.855422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.856165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.856468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.858259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.876813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 372/745] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:03.882329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.892309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8b45-87f4-403f-bc24-0bd0129fca06 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.896902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.897752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.898107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.898286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.905910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.907879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.921518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:03.923038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 374/746] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:03.928638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.941989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b964-a44e-4df8-889b-ba7c1a8debbe admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.948165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.949034 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.949499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.949935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.950961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:03.951408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:03.953620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aeda3e-10d0-4ccc-97a1-c219202f4599 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:03.971856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 373/747] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:03.977437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:03.988864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258645-c908-4ce5-9c3d-f0de419fa8d9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:03.996982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:03.997756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:03.998223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:03.998725 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:03.999686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=26f6ffc1c2bf44aa85d5529cfd469146) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:04.000097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:04.002078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fbee-beeb-4eef-83ba-8dd871fd3c86 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:04.008750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 375/748] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:03 2022] GET /identity/v3/role_assignments?user.id=26f6ffc1c2bf44aa85d5529cfd469146&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:04.066699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520756b0-a6b9-4673-acf3-ec22f97f6c8b None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:04.067348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520756b0-a6b9-4673-acf3-ec22f97f6c8b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:04.067849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520756b0-a6b9-4673-acf3-ec22f97f6c8b None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:04.070143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 374/749] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:04.076428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eb108-9066-498b-b2f8-dc4932eece50 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:04.076845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eb108-9066-498b-b2f8-dc4932eece50 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:04.077052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eb108-9066-498b-b2f8-dc4932eece50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:04.110053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-501eb108-9066-498b-b2f8-dc4932eece50 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:04.111180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-501eb108-9066-498b-b2f8-dc4932eece50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:04.119546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 376/750] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:04 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:04.152257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520756b0-a6b9-4673-acf3-ec22f97f6c8b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:04.170478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520756b0-a6b9-4673-acf3-ec22f97f6c8b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:04.179405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:04.180097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:04.180372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:04.180643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:04.181434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:04.182485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:04.182485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:45:04.182485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:45:04.183379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35bbac-a0de-4583-8969-e7d4d16346ab admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:04.216949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 375/751] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:04 2022] POST /identity/v3/services => generated 240 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:05.198215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235961c5-bf99-49fc-8f81-5bfd6d8decc4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.198733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235961c5-bf99-49fc-8f81-5bfd6d8decc4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.198733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235961c5-bf99-49fc-8f81-5bfd6d8decc4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.200828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 377/752] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:05.206012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.206522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.206522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.233799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:05.234984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:05.253572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 376/753] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:05 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:05.293062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235961c5-bf99-49fc-8f81-5bfd6d8decc4 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.310455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235961c5-bf99-49fc-8f81-5bfd6d8decc4 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.314881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.315667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.315941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.316210 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.331365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:05.338674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:05.340002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 378/754] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:05.345763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.354969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1557-9e30-48b9-8b42-f5e3a1d7694b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.371250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.371869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.372149 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.372412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.373358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:05.373670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.375346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.392059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 377/755] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:05.397739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.413739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55c86c-3fff-4dfd-bae7-5f2ccea0c9d7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.420754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.421540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.421816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.422083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.444378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.446297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.466683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:05.468221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 379/756] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:05.473685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.486193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd70dd0-f02a-4a4b-a101-46c5d58983a3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.496119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.496816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.497097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.497369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.498185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:05.498548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.500159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.520046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 378/757] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:05.525513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.537514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f541a-790b-40b9-bb05-f799a083eeda admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.544740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.545564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.545844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.546110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.561926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.563957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.580297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 03 02:45:05.581796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 380/758] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:05.587199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.602152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8db16-b8d8-4805-8457-05744d307205 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.613166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.613840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.614117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.614389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.615243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:05.615545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.617430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.638663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 379/759] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:05.644421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.657748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb63a-7cdb-416b-89d5-77f7c50547cc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.664877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.665514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.665787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.666083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.680293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.682083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.694288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 381/760] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:05.699825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.710221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597eed-0fb0-40b4-a0e7-e0dff02d2c4c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.721499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.722346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.722621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.722895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.740678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.742569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.770246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:05.772426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 380/761] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:05.777986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.789663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9fd0a-7dd1-4a2e-a0c2-3695d1a82c75 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.805412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.806127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.806380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.806657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.807411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:05.807715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.809349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.825681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 382/762] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:05.831237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.841275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d40b-a6c7-441d-b06f-3134a5dfdb61 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.853038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.853782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.854059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.854360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.868532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.870585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.884212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:05.885917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 381/763] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:05.891278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.905837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0425-52b8-43ed-a839-50c80dd98220 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.916522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.917222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.917501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.917772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.918586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:05.918892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.920862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b5ac5-c119-497b-a466-f61e2cd35e61 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.942109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 383/764] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:05.948093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:05.963325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820e67-3001-4047-a177-1f9be522b334 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:05.969264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:05.970024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.970303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.970575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.971575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=8951b6805c1d4f619c6fc26249eda16f) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:05.971883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:05.973198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268fee-da94-4e04-ac26-d5a7de1b01a4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.973491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268fee-da94-4e04-ac26-d5a7de1b01a4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.973766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268fee-da94-4e04-ac26-d5a7de1b01a4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:05.973921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:05.975914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 384/765] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:05.981330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 382/766] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:05 2022] GET /identity/v3/role_assignments?user.id=8951b6805c1d4f619c6fc26249eda16f&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:05.981642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:05.981819 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:05.981983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.018028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:06.019278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:06.030619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 385/767] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:05 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:06.067691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.079672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb0c6e-18c3-4fb0-9090-eeb849830397 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.090374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.091217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.091504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.091825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.111395 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:06.118825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:06.125106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 383/768] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:06.126175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.140406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe52b1-f5ef-4de1-b496-a054139a3ebe None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.153630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.154340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.154613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.154966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.155755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.156056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.157731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.171570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 386/769] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.176849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.187467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50f638-4dc9-4252-a950-72f7a80683c4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.197328 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.198188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.198475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.198735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.212013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.213930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.246608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:06.247888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 384/770] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:06.253715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.268774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5eb6-48b1-4382-b869-0a7e24b1e1bb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.278994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.279663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.280057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.280325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.281125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.281424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.283030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.300435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 387/771] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.305920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.317233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d75e-46c2-4a11-9b8e-2bec4eafb05f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.327340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.328194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.328485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.328771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.338778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.340950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.363273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:45:06.364766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 385/772] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:06.370442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.387140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d68c-88ea-4422-b075-10efdb4adfbd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.396904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.397896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.398378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.398853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.399917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.400443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.402606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.421127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 388/773] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.426373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.439571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9757-a094-40f5-8a6b-a8bd439251a7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.450550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.451257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.451610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.451884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.461805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.463692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.479063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 386/774] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:06.485012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.499005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33201b6-c4cf-4e80-ad01-1132a2fd243f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.514300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.515565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.516153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.516649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.528192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.530430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.548876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:06.550697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 389/775] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:06.555996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.573394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f977-0df2-43f6-acd8-1e2acf70d2a0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.581709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.582375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.582710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.582985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.583727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.584027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.585713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c728fa3-77d5-4c6c-97b2-eac31a3379c4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.607600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 387/776] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.613364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.621571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69285-04c3-4d6d-9232-8d1d2a9a1079 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.621859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69285-04c3-4d6d-9232-8d1d2a9a1079 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.622133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69285-04c3-4d6d-9232-8d1d2a9a1079 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.624274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 388/777] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:06.627208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60dc4-5dea-46aa-b8a7-1eb754b7d741 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.630662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.630662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.630662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.646309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.647353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.647786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.648196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.649483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:06.650805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:06.656621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.658998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.659598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 389/778] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:06.681866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.682190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:06.683841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 390/779] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:06.688920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.691890 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4b01-dee7-4db7-bae9-954cf24d2659 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.696730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.697717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.698080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.698391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.705107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51412af5-39ba-41ee-9644-11be1826b701 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.710077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:06.717684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:45:06.718121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.718963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.719415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.719517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 390/780] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:06.719963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.720939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.721377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.723338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.726113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.736580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 391/781] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.740864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4a20-ab90-47aa-a896-2fbfa592ad33 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.742397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.745053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.746018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.746457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.746864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.747805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.748244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.750206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.755144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f181-cf60-4003-91d4-28a94f5ec519 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.760364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 391/782] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.766988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.773383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.774056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.774494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.774606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.775462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=a5e2802cd72344deb281b227f9acb3a0) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.775763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.777761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.780353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacef8b-7d3b-4ac8-b752-58ebb47d8763 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.789903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.792757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.793178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.793628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.793924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 392/783] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/role_assignments?user.id=a5e2802cd72344deb281b227f9acb3a0&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.806634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.808821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.828028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-bb9d34dc-9195-4aed-9604-43f6f10f5dd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:06.830003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 392/784] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:06.837900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.854401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58dda3-aa72-4724-bc8d-0cc46b5710d8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.860306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cf37-5f0d-459b-b8e7-6184b64b8bfb None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.860881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cf37-5f0d-459b-b8e7-6184b64b8bfb None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.861292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cf37-5f0d-459b-b8e7-6184b64b8bfb None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.863780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 393/785] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:06.865536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.866403 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.866866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.867294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.868300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:06.869874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.870316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.870807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.873791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.878242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.904287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 393/786] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:06.904706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:06.906281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:06.910243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.925860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 394/787] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:06.926365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd780f-1da9-4e7b-8178-25485ea1b0ac admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.931678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.932738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.933159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.933656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.942218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.944543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.961193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.971625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd085cf-d052-4b90-989d-9775400c7eb7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:06.973057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 03 02:45:06.976859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 394/788] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:06.980626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:06.982218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:06.987169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:06.989806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:06.990256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:06.991218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:06.994192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:06.998646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0250-c0d9-4c6e-bffa-74b1bbf8bf4d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.003359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.004048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.004327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.004613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.005521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.005828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.007721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.010367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 03 02:45:07.014205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 395/789] 10.222.0.31 () {56 vars in 1150 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:07.021481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.038766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927cfae-d9f3-431d-961a-2b366ea61838 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.040418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 395/790] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 3 02:45:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:07.044257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.045329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.045739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.046174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.046362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.047207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.047632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.049659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.055689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 396/791] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:07.061140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.062838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca816b-8f72-484a-b438-e4d4b4772a3b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.071983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116818-3778-4b35-bafa-2883778c21e5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.072868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.073752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.074140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.074507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.077936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.078766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.079260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.079688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.081068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.081519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.083480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.092440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 397/792] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:07.095170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.097480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.097820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.109927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820352be-47c4-43ec-9020-4f904742b7fb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.118246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:07.120936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 396/793] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:07.124040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.125303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.126210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.126486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.127495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.127598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] RBAC: Adding query filter params (interface=public, service_id=ef342a7c4b33433e81daa992cc96cd1e, region_id=RegionOne) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.127849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.129353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:07.129353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:45:07.129353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:45:07.129782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.139340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 398/794] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/endpoints?service_id=ef342a7c4b33433e81daa992cc96cd1e&interface=public®ion_id=RegionOne => generated 194 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:07.145448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.147879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651856f-1ca0-43bb-babd-2c58ce4fd1cc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.158050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.158842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b72ee-30db-4018-a234-c8baf2f7f91d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.159385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.160010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.160481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.161554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.162110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.163335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.163978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.164257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.164528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.164907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.165267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.167109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.173925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 399/795] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services => generated 772 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:07.184173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 397/796] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:07.189669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.203311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7925-2e24-4674-8fb2-1191213c16b2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.209042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.209887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.210169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.210439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.218707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.220801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.235040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-bffb2dd0-424e-41a1-a024-a69e1ac43ee0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:07.236624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 400/797] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:07.242393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.251007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867a9c-79a5-4c6e-b042-8da635e34f1c None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.251349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867a9c-79a5-4c6e-b042-8da635e34f1c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.251555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867a9c-79a5-4c6e-b042-8da635e34f1c None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.252832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91559db-3b5b-485d-a628-6fe2f3825d88 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.253751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 401/798] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:07.258926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.259214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.259485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.261424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.262210 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.262624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.262970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.263955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.264414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.266532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.279855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 398/799] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:07.281981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:07.283285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:07.285686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.302043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 402/800] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:07.303078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0726249-3816-41d9-b2ef-d06ff64eb9bf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.307862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.308895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.309173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.309444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/26f6ffc1c2bf44aa85d5529cfd469146/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.326078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=26f6ffc1c2bf44aa85d5529cfd469146, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.329025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.337320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.348823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f163-bb44-4a7d-a083-e12b564a0433 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.363263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 399/801] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:07 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/26f6ffc1c2bf44aa85d5529cfd469146/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:45:07.432240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.433236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.433516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.433789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.434500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.436310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.448403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 03 02:45:07.450096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 403/802] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services/network => generated 88 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:07.457045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.468518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd315a6-34bf-4938-b3a3-ca9efedfed54 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.473312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.474029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.474362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.474631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.475413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.475720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.477506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.482919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 400/803] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:07.488969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.499448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd4c5f-8068-42d9-ba3d-789be2150d55 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.504836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.505539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.505812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.506131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.506994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.507354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.509108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.515483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 404/804] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:07.521479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.532042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143fc57-df81-4988-a7ce-efba1f2e5d36 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.537871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.538550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.538874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.539143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.540006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] RBAC: Adding query filter params (interface=public, service_id=98957ac015f14a9aa09ee50d53f15e57, region_id=RegionOne) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:07.540318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.541467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:07.541467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:45:07.541467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:45:07.542451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343eba0c-2f77-475c-a265-89dafbecebd4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.551482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 401/805] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/endpoints?service_id=98957ac015f14a9aa09ee50d53f15e57&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:07.557166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:07.569018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b0d4-45cb-40d2-8db7-94c92bd741c4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:07.574809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa328e74-ae7b-46cf-898b-d4906f3287ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:07.575475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa328e74-ae7b-46cf-898b-d4906f3287ba admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:07.575748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa328e74-ae7b-46cf-898b-d4906f3287ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:07.576018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa328e74-ae7b-46cf-898b-d4906f3287ba admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:07.576782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa328e74-ae7b-46cf-898b-d4906f3287ba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:07.578403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa328e74-ae7b-46cf-898b-d4906f3287ba admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:07.584118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 405/806] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:07 2022] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:08.669399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb559381-ec4e-4887-99c2-c380f9a4e8b4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:08.669399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb559381-ec4e-4887-99c2-c380f9a4e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:08.669399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb559381-ec4e-4887-99c2-c380f9a4e8b4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:08.670826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 402/807] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:08.680492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:08.680492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:08.680492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:08.705387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:08.706609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:08.716296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 406/808] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:08 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:08.748231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb559381-ec4e-4887-99c2-c380f9a4e8b4 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:08.768186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb559381-ec4e-4887-99c2-c380f9a4e8b4 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:08.777344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:08.778449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:08.778933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:08.779435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:08.797976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:08.805182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:08.807644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 403/809] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:08.812486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:08.825557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e30092-f342-423e-aed0-6fe82f97f67d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:08.836405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:08.837097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:08.837379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:08.837640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:08.838407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:08.838708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:08.840325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:08.849331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 407/810] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:08.858064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:08.873779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837334-7d86-433a-aeff-2add886b4b29 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:08.884960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:08.885953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:08.886372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:08.886782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:08.906671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:08.908691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:08.930935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:08.935392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 404/811] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:08.938019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:08.959051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9278faa-ad94-453f-8b01-8ee9235eac18 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:08.969318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:08.969991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:08.970268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:08.970633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:08.971370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:08.971671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:08.973307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:08.990502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 408/812] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:08.995596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.009454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ff457-d9a9-4fbe-8a69-5790400cad2f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.016928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.017957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.018438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.018905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.037817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.040110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.058101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 03 02:45:09.059518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 405/813] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:09.065309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.086949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f030b-c562-428d-9b68-6bc413bc12d2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.101363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.102043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.102318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.102585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.103440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:09.103742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.105640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.132402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 409/814] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:09.137578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.153769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481b52-d069-4bad-80f7-08134e69735a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.164876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.165915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.166396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.166892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.184469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.186703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.214753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:09.216331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 406/815] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:09.222212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.238435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4c80b-b7d1-46de-823b-b1d821ab4af5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.253407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.254096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.254376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.254645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.255389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:09.255685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.257356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.274201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 410/816] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:09.279518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.294275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227075df-2b43-465a-bb4f-73f756df3755 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.305324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.306516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.307021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.307513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.326205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.328844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.352555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:09.354619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 407/817] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:09.360216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.377828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b87c19-aa8a-4dfa-a58c-8087e2238f0e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.393363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.394037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.394317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.394589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.395396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:09.395700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.397634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967114e-d0e9-4243-a31b-7057c59df63f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.414011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 411/818] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:09.419599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.438382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640ef5-cc3e-4479-b9e4-5fe4644d39eb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.448882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fcf82-de53-4dd4-9aec-1d67b197a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.450034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fcf82-de53-4dd4-9aec-1d67b197a2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.450516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fcf82-de53-4dd4-9aec-1d67b197a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.451016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fcf82-de53-4dd4-9aec-1d67b197a2f7 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/8951b6805c1d4f619c6fc26249eda16f/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.458040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fcf82-de53-4dd4-9aec-1d67b197a2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=8951b6805c1d4f619c6fc26249eda16f, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.460931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fcf82-de53-4dd4-9aec-1d67b197a2f7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.492607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 408/819] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:09 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/8951b6805c1d4f619c6fc26249eda16f/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:45:09.628378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc12e2-9ed5-4c2e-923d-19c6d73c5180 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.628767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc12e2-9ed5-4c2e-923d-19c6d73c5180 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.628956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc12e2-9ed5-4c2e-923d-19c6d73c5180 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.631028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 412/820] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:09.636539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.637185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.637690 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.661785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:09.663358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:09.745018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 409/821] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:09 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:09.767351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc12e2-9ed5-4c2e-923d-19c6d73c5180 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.790070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc12e2-9ed5-4c2e-923d-19c6d73c5180 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.796709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.797680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.797963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.798287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.798980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.800837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.819907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 03 02:45:09.821210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 413/822] 10.222.0.31 () {56 vars in 1153 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:09.827768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.837896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c488-1aec-47db-ba1d-c6bbcce202fe None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.849371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.850406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.850889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.851396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.852342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:09.852871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.854674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c10c-11c7-431d-adc2-1989b4fd548e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.860095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 410/823] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:09.866074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:09.878595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07114a-4bc1-4e69-8abe-01846c8aca26 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:09.889122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:09.889793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:09.890109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:09.890393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:09.891121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:09.891474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:09.893163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7abba7-f69d-4eae-8220-6c5411674efb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:09.900740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 414/824] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.098492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716a52-18dd-48d9-966c-fe0eef633fd3 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.099144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716a52-18dd-48d9-966c-fe0eef633fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.099615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716a52-18dd-48d9-966c-fe0eef633fd3 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.102883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bb27d-5949-4d85-b1db-e8f1d2ff4d2e None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.103429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bb27d-5949-4d85-b1db-e8f1d2ff4d2e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.103926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bb27d-5949-4d85-b1db-e8f1d2ff4d2e None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.108311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 415/825] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:10.108915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 411/826] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:10.112129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.112663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.113196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.118947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.119234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.119512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.135889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:10.137515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:10.145719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:10.146279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 416/827] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:10.147186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:10.163293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 412/828] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:10.170941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.185234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0201-b8a8-47ae-a87f-ad1b762cdc14 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.187222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.195647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.196449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.196760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.197020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.199866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3475af-9d42-4f05-a4cc-706b6a368371 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.212263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.213122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.213387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.213669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.214356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.216044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.220167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:10.228796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:45:10.230715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 03 02:45:10.230961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 417/829] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:10.231777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 413/830] 10.222.0.31 () {56 vars in 1150 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:10.236581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.240255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.249147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15092a71-8552-42cc-8851-9ac747a955f3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.254195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.255080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.255500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.255971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.256134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0734446-27af-4a0f-b7fb-903286010c51 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.257112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.257663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.259609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.271228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 418/831] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.276795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.277317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.277597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.277878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.278610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.278858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.278975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.280747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.293052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 414/832] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.293531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3449a6-cda5-48d3-82e4-49a1d3c2cf31 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.296328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.303185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.305705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.306192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.307071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.317834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbcd9a-61a3-4480-9dff-84479576fc65 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.325691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.327632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.328329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.329357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.329837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.331735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.332280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.334819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.336043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.345661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 415/833] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.351570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.367861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f331-2a1d-4e80-9732-32d730598d95 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.371593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:10.373022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 419/834] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:10.373572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.374549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.375063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.375531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.376546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.377958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:10.377958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:45:10.377958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:45:10.378336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.379583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.402795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001e92-64ad-4db0-b88d-ef14f6490031 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.408505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 416/835] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:45:10.422309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.423373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.423879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.424390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.425371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.425885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.427748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a4538-e4b7-4588-b0fd-330b15c9600c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.441223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 420/836] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.449870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.467115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc8df5-125a-4de5-bd3d-bd8a081c409e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.472326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.473493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.474082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.474586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.488880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.491230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5aa6-f481-4fc7-8cda-af39d61abd30 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.491729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5aa6-f481-4fc7-8cda-af39d61abd30 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.492215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5aa6-f481-4fc7-8cda-af39d61abd30 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.494624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 421/837] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:10.495103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.502030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.502267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.504570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.526871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 03 02:45:10.528218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 417/838] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:10.537648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:10.538885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:10.541768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.547260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 422/839] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:10 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:10.559338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa05b6-6d4d-453a-8913-4d40c3d777ae admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.574642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.575340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.575614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.575938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.576894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.577200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.579082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.588109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.597738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87150-8187-448b-99f0-813d72e521f9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.604955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.605770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.606047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.606318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.607283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.609349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 418/840] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.613048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.614806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.628357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c35123-e7bd-447d-8cb4-3a2d968503b3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.631256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 03 02:45:10.637778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 423/841] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:10.638008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.639813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.640021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.640183 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.640183 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.655554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.655823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d9af-cbbb-4533-9c03-280934cfe573 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.655996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.665053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.665943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.666373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.666644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.667372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.667670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.670328 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.674292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 419/842] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:10.678722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 424/843] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:10.680008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.684176 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.689319 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b407ea-87f7-4311-8006-4c4fb0175bd8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.694354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.695255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.695599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.695827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bb82a-362f-4b6b-94ca-93cf1b0c5457 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.695925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.700657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.701676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.702407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.703119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.704656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.705479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.707850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.709075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.711253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.716072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 425/844] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:10.721697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.732072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238ed9-e15b-427e-9cb2-0dccb9d7b06f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.734085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:10.737424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.738306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.738783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.739271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.740242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.740344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 420/845] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:10.741451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.741784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:10.741784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:45:10.741784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:45:10.743105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.754961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aab8e-f767-4e47-9a9f-43449252e356 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.760669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.761452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.761810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.762086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.762982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.763434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.765251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.770100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 426/846] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:45:10.779120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 421/847] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.786041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.813915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff2b0-a232-4251-8040-9400fc0f0da0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.819972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.820823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.821202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.821478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.832253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.834320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.852942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:10.854189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 427/848] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:10.860430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.874428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0f927-a38a-4c2a-89d8-0a122e53574e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.880246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.880954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.881234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.881506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.882338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.882644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.884528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238546ce-57ec-4866-b1b5-cffa9c816d5d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.902886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 422/849] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:10.909126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:10.920297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445b554-6aa8-41d1-9bea-d2eccc9996a6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:10.925225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:10.925898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:10.926224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:10.926500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:10.927451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=26f6ffc1c2bf44aa85d5529cfd469146) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:10.927760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:10.929894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76a177-1cd4-4c9f-a03f-e33c3457bbee admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:10.940898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 428/850] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:10 2022] GET /identity/v3/role_assignments?user.id=26f6ffc1c2bf44aa85d5529cfd469146&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.183593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624a54-ca27-4433-9d14-4b971a7c9ce0 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.184181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624a54-ca27-4433-9d14-4b971a7c9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.184181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624a54-ca27-4433-9d14-4b971a7c9ce0 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.186415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 423/851] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:12.192348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.192842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.192916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.210579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:12.211766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:12.219877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 429/852] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:12 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:12.243778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624a54-ca27-4433-9d14-4b971a7c9ce0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.256164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624a54-ca27-4433-9d14-4b971a7c9ce0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.260596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.261435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.261716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.261988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.272676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:12.281233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:12.282758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 424/853] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:12.288631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.297772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5a611-ff96-4305-8b2f-da3b5596fc42 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.302322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.302978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.303257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.303529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.304289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.304592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.306247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.315096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 430/854] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.320571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.330444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78679c-7a08-4c6b-8bd9-027e28fec09e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.335045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.335769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.336047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.336317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.347396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.349302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.365681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:12.367182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 425/855] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:12.372702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.382681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8311f-e4f0-4d56-979c-6b5ea5510a89 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.387218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.387868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.388148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.388420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.389222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.389526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.391131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24132ce-94b1-4a0a-9c39-4cbb45f16161 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.403336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 431/856] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.408847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.418661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dee93-328e-499c-ae25-db5c4a4952f9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.423257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.424044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.424331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.424593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.432711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.434762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.441073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c30c4-97d8-4e08-a0ab-404ed1c78d62 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.441427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c30c4-97d8-4e08-a0ab-404ed1c78d62 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.441764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c30c4-97d8-4e08-a0ab-404ed1c78d62 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.443743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 432/857] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:12.448583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.448969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.449305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.452624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 03 02:45:12.454289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 426/858] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:12.459948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.467771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:12.469090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:12.470452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a840dc-db66-44b1-875f-14bd1d096fcf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.475999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.476912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.477389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.477826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.478105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 433/859] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:12 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:12.479100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.479560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.481607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.500575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 427/860] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.505292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.506420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.512374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd690d-fa9a-45e2-a74c-a43050ef5356 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.516582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78fa0a-dd04-4924-97cc-7ad909b3a79e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.517246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.518099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.518387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.518658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.519637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.521585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.523255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.524189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.524649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.525142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.533813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.535860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.544971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 434/861] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:12 2022] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:12.545817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 428/862] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:12.551788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.577683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e753-2240-444f-b2b1-70f0a439d09b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.582257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.583074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.583347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.583615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.595974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.597849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.618557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:12.620283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 435/863] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:12.625929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.635649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209449-1f09-4f37-9d97-b146838b7acb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.640681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.641548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.641914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.642275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.643135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.643529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.645280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.658563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 429/864] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.664306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.674771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473e5e-2a20-4f79-a39e-0d5d1f58bf01 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.679521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.680450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.680865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.681248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.689202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.691373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.705680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:12.707459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 436/865] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:12.713673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.724206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2127-ccc4-44cf-b9b9-36333be15955 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.729113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.729966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.730331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.730722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.731614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.732036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.734171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c009f-154b-443b-ad1b-10e8812d265a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.747451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 430/866] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:12.753485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.765795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a050a-8b94-4f0a-ba97-e2a54dad7280 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.771211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.771996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.772363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.772756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.773710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=8951b6805c1d4f619c6fc26249eda16f) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.774108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.776066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245e9f6-5d40-44ed-8351-fd7e12143ead admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.782899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 437/867] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/role_assignments?user.id=8951b6805c1d4f619c6fc26249eda16f&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.858420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431016-069d-4dd2-8c37-5502c873baab None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.858608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431016-069d-4dd2-8c37-5502c873baab None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.858874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431016-069d-4dd2-8c37-5502c873baab None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.860709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 431/868] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:12.867410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.867849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.868221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.887798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:12.889255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:12.904886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 438/869] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:12 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:12.921087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431016-069d-4dd2-8c37-5502c873baab None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.934535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431016-069d-4dd2-8c37-5502c873baab None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.939780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.940897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.941320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.941687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.942492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.944269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.956619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 03 02:45:12.962053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 432/870] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:12.964605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:12.974293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deacde-c6ac-4e10-98c6-6986a3f6c98e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:12.979017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:12.979675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:12.979950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:12.980219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:12.980971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:12.981271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:12.982927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540beed-4252-4bf5-b18b-5e056ca9f0f8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:12.989278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 439/871] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:12.994820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.004711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a04c-731e-4938-83ad-5ff2d2b6942a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.009160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.009810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.010087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.010357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.011081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.011379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.013114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16bd1a-829b-471b-9564-ca0da2c57ee5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.018208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 433/872] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:13.310300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663b24d-fc1b-4276-9da7-22dfb892cb4e None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.310861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663b24d-fc1b-4276-9da7-22dfb892cb4e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.310861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663b24d-fc1b-4276-9da7-22dfb892cb4e None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.312940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 440/873] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:13.318285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.318688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.318866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.336587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:13.337817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:13.345747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 434/874] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:13 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:13.369210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663b24d-fc1b-4276-9da7-22dfb892cb4e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.381462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663b24d-fc1b-4276-9da7-22dfb892cb4e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.385771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.386571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.386847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.387115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.397670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:13.404779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 03 02:45:13.406283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 441/875] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:13.412064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.421295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e14b4-9413-4d36-a405-a93381da9346 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.425991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.426670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.426946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.427214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.427986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.428286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.429922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.439077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 435/876] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:13.444571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.457765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d487-3883-4b72-8060-0904428b9eb3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.462370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.463281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.463562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.463831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.474909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.476874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.495188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:13.496832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 442/877] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:13.503066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.513937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c597-08ea-4f39-8e0c-fd6c5aabf703 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.518613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.519327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.519607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.519873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.520659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.521019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.522673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.535810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 436/878] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:13.541257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.551183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14289b79-fa56-454c-a248-634ba179b778 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.555701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.556499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.556799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.557070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.564791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.566914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.581113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 03 02:45:13.582284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 443/879] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:13.590099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.601523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda4bd0-9237-42d2-8c54-b5b37e633df7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.605962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.606624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.606900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.607174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.608053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.608353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.610232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.628874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 437/880] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:13.634018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.650521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a69cb-dded-4851-8571-936579ed16b6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.655342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.655991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.656309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.656583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.665480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.667244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.677034 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 444/881] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:13.682732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.692843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb1c8-0b4c-4175-bca0-a82e659ae5d4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.697339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.698180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.698457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.698769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.709598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.711450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.728946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:13.730561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 438/882] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:13.736431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.746265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bdb85-e011-4370-8af5-6e63d277bd06 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.751016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.751671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.751945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.752212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.753035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.753335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.755047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.767497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 445/883] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:13.772987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.783161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bde95-da11-4df6-a029-579952df74b0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.787787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.788566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.788915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.789186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.796438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.798521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.812107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:13.813639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 439/884] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:13.821162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.832056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfdbc-590b-4d54-9c53-e9fc39a988be admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.837852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.838581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.838858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.839126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.839975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.840277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.842352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1676-8d32-462f-8681-16fc7612a3be admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.855602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 446/885] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:13.861539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:13.872837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48876-a0a4-4e18-99b4-8bafdcbee9dd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:13.877545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae607-497e-4871-846b-fb742751050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:13.878189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae607-497e-4871-846b-fb742751050a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:13.878463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae607-497e-4871-846b-fb742751050a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:13.878781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae607-497e-4871-846b-fb742751050a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:13.879713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae607-497e-4871-846b-fb742751050a admin admin] RBAC: Adding query filter params (role.id=2e17fc50fec34614bbe2995113778b72, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=26f6ffc1c2bf44aa85d5529cfd469146) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:13.879972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae607-497e-4871-846b-fb742751050a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:13.881941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae607-497e-4871-846b-fb742751050a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:13.888125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 440/886] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:13 2022] GET /identity/v3/role_assignments?user.id=26f6ffc1c2bf44aa85d5529cfd469146&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=2e17fc50fec34614bbe2995113778b72 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:14.829990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f38f-6b69-4fae-b15f-df25ba074c08 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:14.830743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f38f-6b69-4fae-b15f-df25ba074c08 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:14.830743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f38f-6b69-4fae-b15f-df25ba074c08 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:14.832555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 447/887] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:14.838160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:14.838672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:14.838817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:14.856799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:14.858103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:14.866858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 441/888] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:14 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:14.890390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f38f-6b69-4fae-b15f-df25ba074c08 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:14.902994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f38f-6b69-4fae-b15f-df25ba074c08 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:14.907445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:14.908250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:14.908529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:14.908889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:14.909563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:14.911194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:14.922759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 03 02:45:14.924226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 448/889] 10.222.0.31 () {56 vars in 1153 bytes} [Thu Feb 3 02:45:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:14.930203 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:14.939297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79447-ad40-4bcf-a198-378b29d5853a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:14.943881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:14.944537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:14.944844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:14.945117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:14.945852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:14.946143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:14.947760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:14.952792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 442/890] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:14.958392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:14.968393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9bdd6-8bf1-4501-bbdf-c9a19c010cd4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:14.973088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:14.973763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:14.974033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:14.974307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:14.975032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:14.975335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:14.976997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:14.982690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 449/891] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:14.989262 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:15.000127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec4d71-886b-4301-9fad-654f0933f6bc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:15.005059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:15.005835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.006107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.006379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.007282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] RBAC: Adding query filter params (interface=public, service_id=33f33cf5d3a348b0bbea5451a1455389, region_id=RegionOne) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:15.007596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:15.009314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117811f6-c0f6-428e-a922-00b97fba3d6f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:15.016027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 443/892] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:14 2022] GET /identity/v3/endpoints?service_id=33f33cf5d3a348b0bbea5451a1455389&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:15.021673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:15.032096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204605-858d-42d2-a10a-89f149c25885 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:15.036775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635737f-8db4-4314-ac7e-2e89c0abf476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:15.037532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635737f-8db4-4314-ac7e-2e89c0abf476 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.037818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635737f-8db4-4314-ac7e-2e89c0abf476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.038089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635737f-8db4-4314-ac7e-2e89c0abf476 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.038850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635737f-8db4-4314-ac7e-2e89c0abf476 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:15.040517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635737f-8db4-4314-ac7e-2e89c0abf476 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:15.046503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 450/893] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:15 2022] GET /identity/v3/services => generated 1029 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:45:15.122904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d599c-7509-40f0-b4cb-2eb457984282 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.123315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d599c-7509-40f0-b4cb-2eb457984282 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.123533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d599c-7509-40f0-b4cb-2eb457984282 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.125720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 444/894] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:15.131560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.131843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.132113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.151412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:15.152621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:15.160732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 451/895] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:15 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:15.183817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d599c-7509-40f0-b4cb-2eb457984282 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:15.196992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d599c-7509-40f0-b4cb-2eb457984282 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:15.201835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:15.202774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.203048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.203381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.204062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:15.205846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:15.217902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 03 02:45:15.219508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 445/896] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:15.225582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:15.235006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860befa-6a32-4b9a-a555-4fd346ed393a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:15.241198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:15.242046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.242507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.242909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.243812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:15.244261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:15.246059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493277c-d114-4839-8a92-11cbc4dc2355 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:15.251409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 452/897] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:15.257206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:15.267641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81267d-f7fb-4b01-a706-ae95cbb4a022 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:15.272646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:15.273161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ccec-e48f-4407-91b5-1f9e45ce3176 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.273441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ccec-e48f-4407-91b5-1f9e45ce3176 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.273707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ccec-e48f-4407-91b5-1f9e45ce3176 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.274046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.274459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.274872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.275705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 453/898] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:15.275937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:15.276371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:15.278217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:15.280624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33b8c-ec73-435d-87e7-594b3ae3a22f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.280967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33b8c-ec73-435d-87e7-594b3ae3a22f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.281243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33b8c-ec73-435d-87e7-594b3ae3a22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.284155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 446/899] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:15.300758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-aae33b8c-ec73-435d-87e7-594b3ae3a22f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:15.302007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-aae33b8c-ec73-435d-87e7-594b3ae3a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:15.310455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 454/900] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:15 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:15.334136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:15.344633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676dcb8-d2b7-4a75-9d15-8b5fc510a944 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:15.349716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1e44-2eb8-4648-b200-403f66cde026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:15.350448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1e44-2eb8-4648-b200-403f66cde026 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:15.350722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1e44-2eb8-4648-b200-403f66cde026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:15.350984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1e44-2eb8-4648-b200-403f66cde026 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:15.351833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1e44-2eb8-4648-b200-403f66cde026 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:15.353580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1e44-2eb8-4648-b200-403f66cde026 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:15.373396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 447/901] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:15 2022] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:16.130553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0af53-ffa2-45f6-afbb-d72c127dfbf3 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.131099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0af53-ffa2-45f6-afbb-d72c127dfbf3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.131099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0af53-ffa2-45f6-afbb-d72c127dfbf3 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.133281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 455/902] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:16.138641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.141419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.141704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.167355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:16.168554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:16.189097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 448/903] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:16 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:16.217917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0af53-ffa2-45f6-afbb-d72c127dfbf3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.231697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0af53-ffa2-45f6-afbb-d72c127dfbf3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.237156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.237975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.238248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.238515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.250304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:16.257501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 03 02:45:16.263653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 456/904] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:16.265223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.274417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bde01-44f6-492a-8e3b-0fef73f90f86 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.279415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.280085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.280365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.280635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.281457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:16.281762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.283383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.296835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 449/905] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:16.298363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.308150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ecc6c-0ded-4dcf-8e1c-ef34d7a0dc26 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.313235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.314018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.314302 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.314563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.325329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.327297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.343209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:16.348845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 457/906] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:16.350496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.360554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450b76b-5eb7-442a-902f-3ee593b8e872 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.365471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.366125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.366401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.366668 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.367407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:16.367703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.369332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.385365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 450/907] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:16.387555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.397578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a00de-3081-4d54-a8c9-17351ef6531a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.402129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.402930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.403197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.403463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.411821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.413889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.428814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 03 02:45:16.430680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 458/908] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:16.436396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.447251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca106d-9ca8-40b2-8fd7-9ccdcf5e4c88 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.452222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.453006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.453287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.453559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.454486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:16.454801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.456649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.479516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 451/909] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:16.481017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.491493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb8b6-3eb8-47c5-bf67-b7b0a8db2ef0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.496134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.497157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.497436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.497705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.509492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.511423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.529893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:16.535865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 459/910] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:16.537322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.547518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e080c7-0e48-40f4-8ef6-98df49ecc961 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.552260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.552990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.553452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.553959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.555434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:16.555904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.557666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.576552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 452/911] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:16.577909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.587967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4b3a-9abc-4f86-a4e4-1718d300ebdf admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.592948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.593843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.594062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.594331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.601695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.603730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.617946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:16.624893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 460/912] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:16.626713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.636920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54897d-7e61-45a2-920d-9979d04010b1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.641685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.642391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.642667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.642941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.643799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:16.644105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.646116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28080-6bbf-4d40-aca6-f8296b85265e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.663448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 453/913] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:16.664798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:16.674770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feadf1-2b41-4544-9259-7046910a0b9f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:16.679491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aec07-c265-42de-ac77-7746bb0af64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:16.680430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aec07-c265-42de-ac77-7746bb0af64a admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:16.680708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aec07-c265-42de-ac77-7746bb0af64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:16.681010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aec07-c265-42de-ac77-7746bb0af64a admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/26f6ffc1c2bf44aa85d5529cfd469146/roles/2e17fc50fec34614bbe2995113778b72` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:16.683364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aec07-c265-42de-ac77-7746bb0af64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=26f6ffc1c2bf44aa85d5529cfd469146, role_id=2e17fc50fec34614bbe2995113778b72)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:16.686379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aec07-c265-42de-ac77-7746bb0af64a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:16.704818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 461/914] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:16 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/26f6ffc1c2bf44aa85d5529cfd469146/roles/2e17fc50fec34614bbe2995113778b72 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:45:17.356143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2f3c-dad3-4e07-a504-96892b87e8d4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.356663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2f3c-dad3-4e07-a504-96892b87e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.356663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2f3c-dad3-4e07-a504-96892b87e8d4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.358756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 454/915] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:17.367168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.367699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.368008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.387925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:17.389235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:17.452836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 462/916] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:17 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:17.471641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2f3c-dad3-4e07-a504-96892b87e8d4 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.484622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2f3c-dad3-4e07-a504-96892b87e8d4 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.489459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.490370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.490649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.490921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.491656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.493343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.505651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 03 02:45:17.506876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 455/917] 10.222.0.31 () {56 vars in 1153 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:17.513246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.522925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15831e-051a-45e7-bb6f-c55c41234b62 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.527705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.528369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.528697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.529009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.529810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:17.530110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.531761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.540826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 463/918] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:17.542993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.552990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58763c61-9621-47fe-ae32-2b2198a04c21 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.558258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.559005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.559284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.559611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.560821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:17.561370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.563585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e9468-e970-4284-be31-5a477ffcc501 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.569483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 456/919] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:17.575330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.581844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60861-6601-4bbc-b1bb-9b3c3510a3b4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.582135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60861-6601-4bbc-b1bb-9b3c3510a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.582414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60861-6601-4bbc-b1bb-9b3c3510a3b4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.584186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 457/920] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:17.585661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b363ce-cce9-43d8-89bb-353fde115d86 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.589930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.590439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.590681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638a53-3b5a-4008-b299-b7fd2c285bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.591065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.591334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638a53-3b5a-4008-b299-b7fd2c285bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.591611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638a53-3b5a-4008-b299-b7fd2c285bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.592299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638a53-3b5a-4008-b299-b7fd2c285bd2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.593112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd638a53-3b5a-4008-b299-b7fd2c285bd2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.594946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd638a53-3b5a-4008-b299-b7fd2c285bd2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.610821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:17.612601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:17.625040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 464/921] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:17.630358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250393-ac89-4fff-bdf2-67decb32e045 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.630640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250393-ac89-4fff-bdf2-67decb32e045 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.630920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250393-ac89-4fff-bdf2-67decb32e045 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.633063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 465/922] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:17.634887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 458/923] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:17 2022] POST /identity/v3/auth/tokens => generated 1850 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:17.640888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.641170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.641441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.659573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.660922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:17.662133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:17.670615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 466/924] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:17 2022] POST /identity/v3/auth/tokens => generated 1850 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:17.670932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cbc91-df01-4a09-a558-7a36605b9988 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.675936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.676966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.677427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.677970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.678903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.680904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.694797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.699771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 459/925] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:17 2022] POST /identity/v3/services => generated 241 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:45:17.704446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6cab3-4268-4960-8f5d-e59e3eb22399 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.720667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.721542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.721809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.722080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.722772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.724509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.737017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 03 02:45:17.738639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 467/926] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:17.745010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.757012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b470-2b24-4efe-8621-59e1f0fb29a2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.762399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.763692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.764216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.764771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.765834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:17.766371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.768342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.775856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 460/927] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:17.781458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.793247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9a374-8239-4f3f-bcb6-94204bf4a6e5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.799652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.801119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.801725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.802200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.803177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:17.803767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.805750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.812472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 468/928] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:17.818106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.829378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1810b-9c56-45a0-a783-b7330c9478ee admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.834731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.835422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.835705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.835981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.836880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] RBAC: Adding query filter params (interface=public, service_id=c3fbe32b20a34c4c91042a6993c170fa, region_id=RegionOne) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:17.837263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.838980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee46ac-2131-43ba-9524-3d445377deeb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.846300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 461/929] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/endpoints?service_id=c3fbe32b20a34c4c91042a6993c170fa&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:17.852143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:17.863201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725606d-e7a8-4548-b578-9f9a17dca606 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:17.868024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009e0d7-3dd6-409e-a5cb-663246eb0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:17.868695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e0d7-3dd6-409e-a5cb-663246eb0d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:17.869013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e0d7-3dd6-409e-a5cb-663246eb0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:17.869334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e0d7-3dd6-409e-a5cb-663246eb0d05 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:17.870043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009e0d7-3dd6-409e-a5cb-663246eb0d05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:17.871698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009e0d7-3dd6-409e-a5cb-663246eb0d05 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:17.878784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 469/930] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:17 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:45:18.944193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a128-df1c-40cd-8350-285a7b925415 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:18.945107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a128-df1c-40cd-8350-285a7b925415 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:18.945524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a128-df1c-40cd-8350-285a7b925415 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:18.947698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 462/931] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:18.953434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:18.954224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:18.954710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:18.973873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:18.975364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:18.988991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 470/932] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:18 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:19.008892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a128-df1c-40cd-8350-285a7b925415 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.021857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a128-df1c-40cd-8350-285a7b925415 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.026477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.027492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.027963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.028433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.039213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:19.046620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 03 02:45:19.052861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 463/933] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:19.054403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.063807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5a35b-7fc9-48c3-b5fa-742365834c17 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.068534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.069454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.069971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.070436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.071389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:19.071898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.073719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.088272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 471/934] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:19.089854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.100704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e7631-e40f-4d14-9085-f418bdfdbbc4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.105542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.106579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.107053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.107537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.118540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.120673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.137784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:19.143934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 464/935] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:19.145577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.155848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3116-d0a7-474a-a59e-fc60cc46ae51 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.160678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.161653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.162126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.162589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.163546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:19.164067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.165881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.178690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 472/936] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:19.184377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.193891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1e79-6df0-4fd7-85f7-9011e92bdc22 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.198619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.199609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.200062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.200510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.208013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.210260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.225483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 03 02:45:19.227150 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 465/937] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:19.233086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.243485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106df48-82fa-4611-a66c-f115e6ec99ff admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.248227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.249115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.249567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.250008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.251039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:19.251521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.253569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.271924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 473/938] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:19.277901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.288194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2896-3d65-4774-9be7-339aa66f4a14 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.293144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.294004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.294453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.295043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.303270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.305288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.314687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 466/939] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:19.320501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.330491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb960-caae-43fd-8f66-8fe8fb511a94 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.335370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.336439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.336907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.337340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.348464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.350635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.368130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:19.369901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 474/940] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:19.375766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.384921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a7d2-30f4-488d-9b30-d69ccdc52fca admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.389804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.390670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.391111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.391542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.392512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:19.393004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.394801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.408373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 467/941] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:19.414382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.424623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7e83-d5af-4b6a-a13b-9f317e78d3af admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.429703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.430733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.431178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.431632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.439414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.441643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.455183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:19.456940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 475/942] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:19.462923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.473308 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8e9b-ca4e-4a1c-a286-58d594e0df4e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.478279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.479173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.479615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.480096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.481105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:19.481602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.483750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95b2f-f5e6-4af8-a72e-f396d76b11f2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.497292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 468/943] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:19.503661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:19.515254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20f26-0866-4d49-8728-9b1e7adbbc9f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:19.520705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:19.521499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.521834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.522206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.523107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] RBAC: Adding query filter params (role.id=2e17fc50fec34614bbe2995113778b72, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=26f6ffc1c2bf44aa85d5529cfd469146) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:19.523532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:19.525566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ffa4e-0f1f-432d-9361-287c6c6d64d6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:19.532826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 476/944] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/role_assignments?user.id=26f6ffc1c2bf44aa85d5529cfd469146&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=2e17fc50fec34614bbe2995113778b72 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:19.931115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf03c5-a1b0-4501-8bd7-1578f958eae4 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.931828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf03c5-a1b0-4501-8bd7-1578f958eae4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.932306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf03c5-a1b0-4501-8bd7-1578f958eae4 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.934552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 469/945] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:19.939586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ff1b4-71d2-4cef-a09d-f5a64e73cb99 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.939797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.939909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ff1b4-71d2-4cef-a09d-f5a64e73cb99 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.940057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.940151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ff1b4-71d2-4cef-a09d-f5a64e73cb99 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.940291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.942299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 470/946] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:19.947450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:19.948000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:19.948000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:19.958275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:19.959625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:19.965921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:19.967265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:19.968135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 477/947] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:19 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:19.978745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 471/948] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:19 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:19.991156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.000542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652762a-2d72-4d26-acdf-b8f3e1b7618d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.002658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.005524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.006456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.006839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.007213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.007986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.009712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.013352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67de2e-dc86-4527-a9e7-d47bcd0c1184 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.018249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.019262 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.019707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.020143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.021023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.021357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 03 02:45:20.022914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 478/949] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:20.023278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.028779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.035919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 03 02:45:20.037647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 472/950] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:20.040837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ead6-89ba-408c-a88c-85d3ee831f1a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.043745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.045961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.046777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.047198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.047630 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.048483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.048964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.050707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.054469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef85d21-ff58-44e1-bf31-485309f80bd8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.055988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 479/951] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:20.059499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.060458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.060971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.061455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.061569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.062572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.063065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.064875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.071567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ff5e3-7749-4488-87e5-3d49d5eb92e8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.076419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.076664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 473/952] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:20.077133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.077416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.077691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.078470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.078768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.082005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.088831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 480/953] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:20.088987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.102052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba815b-902f-4433-9119-3499b88a2fc5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.107164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.108289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.108780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.109258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.110179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.110658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.112871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.123998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 474/954] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:20.125929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.136370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9839d-2cc6-4f1d-b22d-c75db54598f8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.141452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.142532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.143010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.143473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.144483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] RBAC: Adding query filter params (interface=public, service_id=1723430a98d24692b0dd8636662597d0, region_id=RegionOne) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.145023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.146872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45461ba-283b-42f6-9cc6-fabe6f6e2245 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.157858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 481/955] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/endpoints?service_id=1723430a98d24692b0dd8636662597d0&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:20.159636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.170173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30fe89-5965-4eb5-ac79-28521daaf1db admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.172967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df278dc0-5a40-4f0f-93b1-de4efaf89eaa None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.173463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df278dc0-5a40-4f0f-93b1-de4efaf89eaa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.173906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df278dc0-5a40-4f0f-93b1-de4efaf89eaa None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.176511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 482/956] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:20.180705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.181507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.181727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.181992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.182713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.184380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.186437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.186971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.187432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.197153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 475/957] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services => generated 1497 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:45:20.211880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:20.213678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:20.222551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 483/958] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:20 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:20.247002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.258367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3020792-bb7a-483b-832b-06193199c689 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.264025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.265589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.265589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.265589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.266106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.267727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.280505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 03 02:45:20.284765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 476/959] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:20.287600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.299974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e280135-f359-4eec-83e0-7b0bb05702c3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.305080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.305913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.306290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.306726 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.307571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.308002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.309888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.316143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 484/960] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:20.321851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.332949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2e949-eeae-4c4e-95f1-9e1e25b43254 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.338211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.339208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.339657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.340078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.343148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:20.343662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.345555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789257f5-ab89-45dc-87c2-006679c76c34 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.351888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 477/961] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 3 02:45:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:20.357895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:20.368911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6b64-8866-4a20-b13e-ddf9d64df49e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:20.373847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb4d3-fa80-44fb-bcfd-49980f24d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:20.374508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb4d3-fa80-44fb-bcfd-49980f24d0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:20.374786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb4d3-fa80-44fb-bcfd-49980f24d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:20.375057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb4d3-fa80-44fb-bcfd-49980f24d0a3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:20.375811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb4d3-fa80-44fb-bcfd-49980f24d0a3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:20.377478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb4d3-fa80-44fb-bcfd-49980f24d0a3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:20.398826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 485/962] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:21.773637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb129-c05c-4ee9-b4cc-671fbbafb76d None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:21.774185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb129-c05c-4ee9-b4cc-671fbbafb76d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:21.774185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb129-c05c-4ee9-b4cc-671fbbafb76d None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:21.776197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 478/963] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:21.781647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:21.782051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:21.782233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:21.799944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:21.801178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:21.817914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 486/964] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:21 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:21.839777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb129-c05c-4ee9-b4cc-671fbbafb76d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:21.852118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb129-c05c-4ee9-b4cc-671fbbafb76d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:21.856477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:21.857330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:21.857603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:21.857868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:21.858532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:21.860116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:21.871053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 03 02:45:21.872485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 479/965] 10.222.0.31 () {56 vars in 1126 bytes} [Thu Feb 3 02:45:21 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:21.878614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:21.887601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faaa35-878e-4d2c-acbb-87b795a4f1bd None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:21.892174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:21.892852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:21.893129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:21.893395 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:21.894108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:21.894404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:21.895996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b55dd0-3997-4a95-9076-c220dc83d7e8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:21.901152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 487/966] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:21.906861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:21.916641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ebe0-e862-497e-b76e-0b480edd0f43 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:21.921226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:21.921919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:21.922194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:21.922460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:21.923175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:21.923469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:21.925088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19616-7e65-47d9-a2ff-88971bc30be4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:21.930185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 480/967] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:22.338283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26bcc1-b259-47a6-a6b2-d9c2074b7519 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.338469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26bcc1-b259-47a6-a6b2-d9c2074b7519 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.338732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26bcc1-b259-47a6-a6b2-d9c2074b7519 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.340820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 488/968] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:22.346193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb897-3682-4c6e-be46-463cbc3c33b0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.346482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb897-3682-4c6e-be46-463cbc3c33b0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.346757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb897-3682-4c6e-be46-463cbc3c33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.367362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-620fb897-3682-4c6e-be46-463cbc3c33b0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:22.368588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-620fb897-3682-4c6e-be46-463cbc3c33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:22.377171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 481/969] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:22 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:22.400809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26bcc1-b259-47a6-a6b2-d9c2074b7519 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.413247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26bcc1-b259-47a6-a6b2-d9c2074b7519 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.417820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9787-292b-44d2-ba49-cfb8444d5edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.418474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9787-292b-44d2-ba49-cfb8444d5edd admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.418752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9787-292b-44d2-ba49-cfb8444d5edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.419021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9787-292b-44d2-ba49-cfb8444d5edd admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.419813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c9787-292b-44d2-ba49-cfb8444d5edd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.421572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c9787-292b-44d2-ba49-cfb8444d5edd admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.441134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 489/970] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:22 2022] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:22.536493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045e6d-cecd-4db8-bc39-5e2bca8e4106 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.536854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045e6d-cecd-4db8-bc39-5e2bca8e4106 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.537141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045e6d-cecd-4db8-bc39-5e2bca8e4106 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.539371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 482/971] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:22.545860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf167-f2f0-4f6d-96b8-e28809d482d0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.546456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf167-f2f0-4f6d-96b8-e28809d482d0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.546977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf167-f2f0-4f6d-96b8-e28809d482d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.567364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-03baf167-f2f0-4f6d-96b8-e28809d482d0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:22.569102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-03baf167-f2f0-4f6d-96b8-e28809d482d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:22.592972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 490/972] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:22 2022] POST /identity/v3/auth/tokens => generated 2234 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:22.613717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045e6d-cecd-4db8-bc39-5e2bca8e4106 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.626776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045e6d-cecd-4db8-bc39-5e2bca8e4106 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.629465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ad0b-a2ea-44d5-a7d9-f72b7dea2470 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.629757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ad0b-a2ea-44d5-a7d9-f72b7dea2470 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.630036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ad0b-a2ea-44d5-a7d9-f72b7dea2470 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.631826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.632194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 491/973] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:22.632693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.633005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.633264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.635276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.636921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.639255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.639571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.640298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.649071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 03 02:45:22.652799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 483/974] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:22.656576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.659902 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:22.661101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:22.666621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3ac5-3afd-4040-ba8c-5a481eb4fda5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.670718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 492/975] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:22 2022] POST /identity/v3/auth/tokens => generated 2234 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:22.673517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.674186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.674462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.674727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.675451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:22.675760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.677482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.682728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 484/976] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:22.688757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.694753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.698766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c9aa-70be-4d02-b5e4-4f2a31e448fb None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.704423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.704910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.705190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.705460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.705821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485579d-abc6-447c-a82a-1d6e81092e21 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.706186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:22.706487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.708099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.710459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.710980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.711339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.711586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.712252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.716930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 493/977] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:22.717060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.717060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.common [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 03 02:45:22.719325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.728852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da921cda-9372-42df-9fd1-b9d4500daea1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.734013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.734701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.734986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.735255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.735609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.sql.core [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 03 02:45:22.735609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 03 02:45:22.735609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [parameters: {'id': '03e038fd9c9641f5b9d672c3f623a126', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 03 02:45:22.735609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 03 02:45:22.736006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.738064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.742677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03e038fd9c9641f5b9d672c3f623a126.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03e038fd9c9641f5b9d672c3f623a126. Feb 03 02:45:22.744293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 485/978] 10.222.0.31 () {60 vars in 1161 bytes} [Thu Feb 3 02:45:22 2022] POST /identity/v3/projects => generated 262 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:22.750293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.765300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa53f6-6023-464f-b6c6-cb4ab33b5c24 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.765793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 494/979] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:22.796429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.797294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.797622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.797998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.806874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.809212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.824220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-54130d1d-d390-4ced-b5a0-ccbb7572de14 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:22.825983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 486/980] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:22.832296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:22.843815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e9ab-8d9a-49a1-804f-f1c16ee612f0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:22.848761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:22.849463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:22.849790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:22.850065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:22.850866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:22.851266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:22.853343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90aa1c-619d-4166-87bc-3f47520fb358 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:22.874782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 495/981] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:24.181081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f60a5-8ba1-4619-ba0b-a9b37043e71e None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.181847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f60a5-8ba1-4619-ba0b-a9b37043e71e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.181847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f60a5-8ba1-4619-ba0b-a9b37043e71e None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.183569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 487/982] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:24.189886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd39a0-9ac7-441f-b8a2-a87eae7ce3f7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.189886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd39a0-9ac7-441f-b8a2-a87eae7ce3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.189886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd39a0-9ac7-441f-b8a2-a87eae7ce3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.208494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-73bd39a0-9ac7-441f-b8a2-a87eae7ce3f7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:24.210011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-73bd39a0-9ac7-441f-b8a2-a87eae7ce3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:24.222499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 496/983] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:24 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:24.245395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f60a5-8ba1-4619-ba0b-a9b37043e71e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:24.258605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f60a5-8ba1-4619-ba0b-a9b37043e71e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:24.263217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745d4d2-c9c4-4913-a678-f86df00e7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:24.264118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745d4d2-c9c4-4913-a678-f86df00e7e2c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.264587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745d4d2-c9c4-4913-a678-f86df00e7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.265091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745d4d2-c9c4-4913-a678-f86df00e7e2c admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.266018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745d4d2-c9c4-4913-a678-f86df00e7e2c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:24.267871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745d4d2-c9c4-4913-a678-f86df00e7e2c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:24.289013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 488/984] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:24 2022] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:24.695353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a82c-a814-4f97-a0db-4dbe995dd2a4 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.695666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a82c-a814-4f97-a0db-4dbe995dd2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.695930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a82c-a814-4f97-a0db-4dbe995dd2a4 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.697986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 497/985] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:24.703542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.703828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.704097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.725604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:24.727096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:24.744438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 489/986] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:24 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:24.767687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48a82c-a814-4f97-a0db-4dbe995dd2a4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:24.780709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48a82c-a814-4f97-a0db-4dbe995dd2a4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:24.785299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:24.786110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.786377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.786647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.787307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:24.788960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:24.800254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 03 02:45:24.801785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 498/987] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:24.807893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:24.816921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884270-1c00-4ad6-9ccc-6078c3bf3aa6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:24.821448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:24.822085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.822360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.822634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.823348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:24.823650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:24.825263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:24.830287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 490/988] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:24.835522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:24.845181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40515-ec4b-4e58-8ebc-95af8e961fd8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:24.849734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:24.850380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.850653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.850923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.851634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:24.851929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:24.853571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:24.858897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 499/989] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:24.864995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:24.875267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7338a-8690-4374-bfd4-a9062bc37650 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:24.880167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:24.880900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.881175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.881440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.882269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] RBAC: Adding query filter params (interface=public, service_id=4434bfa94c6846c5a263cdbf4390ad59, region_id=RegionOne) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:24.882570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:24.884225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dba88a-9368-4ef5-9ba1-50eca65049fd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:24.890603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 491/990] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:24 2022] GET /identity/v3/endpoints?service_id=4434bfa94c6846c5a263cdbf4390ad59&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:24.896375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:24.906488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d943-32e2-4465-9f04-e780bb7012e5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:24.911101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d88e7-6840-44d7-8063-e5c6ffbd41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:24.911761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d88e7-6840-44d7-8063-e5c6ffbd41dc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:24.912029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d88e7-6840-44d7-8063-e5c6ffbd41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:24.912344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d88e7-6840-44d7-8063-e5c6ffbd41dc admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:24.913120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d88e7-6840-44d7-8063-e5c6ffbd41dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:24.914771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d88e7-6840-44d7-8063-e5c6ffbd41dc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:24.921842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 500/991] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:24 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:45:25.029674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5554-3218-49e5-b11e-102c17163aa9 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.029980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5554-3218-49e5-b11e-102c17163aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.030146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5554-3218-49e5-b11e-102c17163aa9 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.032211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 492/992] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:25.037986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.038258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.038528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.058628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:25.060162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:25.072752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 501/993] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:25 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:25.095476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5554-3218-49e5-b11e-102c17163aa9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.110905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5554-3218-49e5-b11e-102c17163aa9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.116391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.117229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.117506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.117773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.118444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.120063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.131914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-9218f745-10c9-4d4c-91c2-7e3d9455c033 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 03 02:45:25.133488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 493/994] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:25.139587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.142271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5744-42ef-4979-8caa-7c94a1ce6bc5 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.142543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5744-42ef-4979-8caa-7c94a1ce6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.142814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5744-42ef-4979-8caa-7c94a1ce6bc5 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.144633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 494/995] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:25.149414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1c46-67d8-41fd-bb19-7e5ca8a65697 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.149755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.150040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.150313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.157319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.158161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.158604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.158916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.159645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:25.159957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.161691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.167390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 502/996] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:25.173233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.173682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:25.175047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:25.183397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2adf17-6e5d-4497-a07b-4a63472da928 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.183827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 495/997] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:25 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:25.192133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.192905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.193283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.193618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.194452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:25.194824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.196537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.202500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 503/998] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:25.208334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.213162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.218898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a91a3-395a-4ce2-9687-05f96f719cd9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.223341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4b2a-045e-4a53-af10-fe55bb1ec646 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.224711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.225705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.226180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.226589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.227801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] RBAC: Adding query filter params (interface=admin, service_id=1723430a98d24692b0dd8636662597d0, region_id=RegionOne) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:25.228259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.228385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.229147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.229495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.229832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.230617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.230992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.232647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.234078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.common [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 03 02:45:25.238198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 496/999] 10.222.0.31 () {56 vars in 1270 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/endpoints?service_id=1723430a98d24692b0dd8636662597d0&interface=admin®ion_id=RegionOne => generated 193 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:25.246251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.253702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.sql.core [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 03 02:45:25.253702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 03 02:45:25.253702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [parameters: {'user_id': '983add844d6149758c7b3b3df068e1e2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 03 02:45:25.253702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 03 02:45:25.257515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787a11-1210-4ef5-8edb-05302fc5dbd2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.262499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.263428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.263910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.264393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.265346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.267178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.268625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 03 02:45:25.275012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 504/1000] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:45:25 2022] POST /identity/v3/users => generated 160 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:25.277382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.278390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 497/1001] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/services => generated 1957 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:45:25.291165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fe3d-ab6e-4835-b6f2-4f6190f196e0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.296934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.297813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.298238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.298602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.307936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.310452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.325754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-8f93db16-1957-41a0-a70f-9dfbe21bb6c6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 03 02:45:25.327467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 505/1002] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:25.333328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:25.344650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b571-0936-4f72-897c-43fe62ddd4d6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:25.350168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:25.351282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:25.351795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:25.352294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:25.353419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:25.353969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:25.356188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fe056-3e7f-4dd2-b826-e685fbd9c0a9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:25.397965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 498/1003] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 3 02:45:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:26.555486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550efa2-82ec-45d0-b509-a846c2c41b93 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.556090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550efa2-82ec-45d0-b509-a846c2c41b93 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.556090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550efa2-82ec-45d0-b509-a846c2c41b93 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.560971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 506/1004] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:26.566127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.566540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.566637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.585603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:26.586764 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:26.594920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 499/1005] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:26 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:26.617531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550efa2-82ec-45d0-b509-a846c2c41b93 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:26.630174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550efa2-82ec-45d0-b509-a846c2c41b93 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:26.634829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:26.635597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.635858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.636120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.636796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:26.638507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:26.649483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 03 02:45:26.650814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 507/1006] 10.222.0.31 () {56 vars in 1126 bytes} [Thu Feb 3 02:45:26 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:26.656639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:26.665761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2226a1-8732-4970-ab6d-8628d1d15538 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:26.670750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:26.671396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.671618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.671915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.672628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:26.672959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:26.674542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:26.679643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 500/1007] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:26.685048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:26.694660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e1ba-aeb5-4f26-97ba-0b2a4eb32a66 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:26.699586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:26.700223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.700501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.700766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.705733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:26.706041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:26.707640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:26.712890 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 508/1008] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:26.718497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:26.728177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557af6-1e4c-4958-b245-170656e2b558 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:26.733156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:26.733789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.734069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.734272 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.735100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] RBAC: Adding query filter params (interface=public, service_id=1f57791fad2d40cdbd6ef619d4d0668e, region_id=RegionOne) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:26.735397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:26.737291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d90ece-357e-4e7c-9783-869bcafeeb98 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:26.743048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 501/1009] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:45:26 2022] GET /identity/v3/endpoints?service_id=1f57791fad2d40cdbd6ef619d4d0668e&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:26.748318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:26.758660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec9279-2b9b-445a-af20-8feeed3b4831 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:26.763612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98d97e-94c2-46c6-a253-d2812f296032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:26.764274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98d97e-94c2-46c6-a253-d2812f296032 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:26.764508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98d97e-94c2-46c6-a253-d2812f296032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:26.764839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98d97e-94c2-46c6-a253-d2812f296032 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:26.765531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98d97e-94c2-46c6-a253-d2812f296032 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:26.767117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98d97e-94c2-46c6-a253-d2812f296032 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:26.773892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 509/1010] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:45:26 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:45:27.147788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415368-1e63-4dcc-9a28-26b19ddfb863 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.148150 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415368-1e63-4dcc-9a28-26b19ddfb863 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.148330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415368-1e63-4dcc-9a28-26b19ddfb863 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.150201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 502/1011] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:27.155671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.155918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.156212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.174901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:27.176404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:27.184816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 510/1012] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:27 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:27.209817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25415368-1e63-4dcc-9a28-26b19ddfb863 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.222828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25415368-1e63-4dcc-9a28-26b19ddfb863 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.227399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.228176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.228447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.228732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.229398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.230977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.241995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 03 02:45:27.243304 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 503/1013] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:27.249394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.258899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6d3f9-1807-41a3-8ff7-b10000ad09b8 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.263976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.264660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.264971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.265204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.265998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:27.266295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.267961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.273859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 511/1014] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:27.279905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.289929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86e84-0301-4427-b6d2-59c4dae7b977 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.294580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.295260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.295534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.295794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.296521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:27.296847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.298440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42389d83-9164-4e18-ab87-311b35fcb414 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.303675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 504/1015] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 3 02:45:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:27.309404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.319297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732b637-02cc-4ffd-ab59-3a56645bf776 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.323892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57398dad-aa8b-4f49-8c32-6a66afdd820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.324609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398dad-aa8b-4f49-8c32-6a66afdd820d admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.325020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398dad-aa8b-4f49-8c32-6a66afdd820d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.325354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398dad-aa8b-4f49-8c32-6a66afdd820d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.326171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57398dad-aa8b-4f49-8c32-6a66afdd820d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.327777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57398dad-aa8b-4f49-8c32-6a66afdd820d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.346399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 512/1016] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:27.523393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8582-9552-425d-9610-55996079aab5 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.524044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8582-9552-425d-9610-55996079aab5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.524321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8582-9552-425d-9610-55996079aab5 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.526353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 505/1017] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:27.531596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.531886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.532186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.551490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:27.552671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:27.570742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 513/1018] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:27 2022] POST /identity/v3/auth/tokens => generated 2675 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:27.594096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8582-9552-425d-9610-55996079aab5 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.607493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8582-9552-425d-9610-55996079aab5 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.612354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.613688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.613688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.613862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.614435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.616010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.627672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 03 02:45:27.629120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 506/1019] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 3 02:45:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:27.635096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.644402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1c9a7-f6d1-4778-a95a-81f0ec237361 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.649103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.649765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.650053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.650314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.651048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:27.651342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.652995 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.658368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 514/1020] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:27.663918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.674030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52632eb-2503-4347-b485-d8fdfe660021 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.678471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.679122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.679375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.679639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.680343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:27.680639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.682265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bd5e7-fa5f-4f90-bb8a-7e561c04b0bc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.687047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 507/1021] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 3 02:45:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:27.692617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:27.702361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba191-5838-426c-ae55-2ceeae17bd6e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:27.706829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64acc3f-8f0c-4803-95c5-44900e82d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:27.707472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acc3f-8f0c-4803-95c5-44900e82d64d admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:27.707749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acc3f-8f0c-4803-95c5-44900e82d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:27.708020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acc3f-8f0c-4803-95c5-44900e82d64d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:27.708797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64acc3f-8f0c-4803-95c5-44900e82d64d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:27.710402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64acc3f-8f0c-4803-95c5-44900e82d64d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:27.726303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 515/1022] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:28.969239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c7336-9b84-4329-8d76-b89ab9aec6e0 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:28.969758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c7336-9b84-4329-8d76-b89ab9aec6e0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:28.969758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c7336-9b84-4329-8d76-b89ab9aec6e0 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:28.971590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 508/1023] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:28.977102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:28.977537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:28.977615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:28.996472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:28.997732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:29.015521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 516/1024] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:28 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:29.038900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c7336-9b84-4329-8d76-b89ab9aec6e0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.051634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c7336-9b84-4329-8d76-b89ab9aec6e0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.056480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.057315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.057589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.057853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.058519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.060110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.076620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 03 02:45:29.078050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 509/1025] 10.222.0.31 () {56 vars in 1126 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:29.084073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.093332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc9348-1d42-4705-8189-3e02d9b9c717 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.098556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.099204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.099481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.099749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.100454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:29.100762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.102376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.108834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 517/1026] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:29.113515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.123605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83509a-f90e-4e98-ad92-ebb8213b285f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.128419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.129109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.129390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.129661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.130386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:29.130814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.132417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5f31b-9eca-4a4b-926b-ef0050786f4b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.137745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 510/1027] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:29.143524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.153439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf2d1-bb72-47a6-9068-a87cf667e6a5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.158507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53b4a5-bc7c-4ee4-b730-bea96dd5e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.159161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53b4a5-bc7c-4ee4-b730-bea96dd5e6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.159429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53b4a5-bc7c-4ee4-b730-bea96dd5e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.159695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53b4a5-bc7c-4ee4-b730-bea96dd5e6c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.160448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53b4a5-bc7c-4ee4-b730-bea96dd5e6c2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.162137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53b4a5-bc7c-4ee4-b730-bea96dd5e6c2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.181775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 518/1028] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:45:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:29.652140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdcb6-48ff-4e7a-b8d1-da8f3d55b3df None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.652527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdcb6-48ff-4e7a-b8d1-da8f3d55b3df None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.652757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdcb6-48ff-4e7a-b8d1-da8f3d55b3df None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.654655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 511/1029] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:29.659968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.660257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.660487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.678959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:29.680130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:29.700390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 519/1030] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:29.724734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdcb6-48ff-4e7a-b8d1-da8f3d55b3df None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.738198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdcb6-48ff-4e7a-b8d1-da8f3d55b3df None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.742923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.743725 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.744058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.744371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.755503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:29.762816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 03 02:45:29.764205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 512/1031] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:29.769983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.779417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2a27-5e64-448a-81ee-138f8214c56a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.785251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.785944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.786195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.786477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.787228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:29.787524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.789144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.798080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 520/1032] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:29.803696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.813718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311881a4-e1b7-476f-80fc-8336af17f763 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.818609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.819388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.819660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.819921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.830336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.832171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.848856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:29.850193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 513/1033] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:29.855817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.866241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d480b-c07d-49d8-8c02-03fb17285aa4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.871194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.871839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.872111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.872363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.873148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:29.873443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.875034 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.887358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 521/1034] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:29.892941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.903329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ad63-6374-4d4a-99f5-248f540d6041 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.908067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.909098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.909380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.909646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.917545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.919688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.933472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-bca5cdbd-72fd-4a3c-a2b8-d0d77af4bfee admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:45:29.934812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 514/1035] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:29.940805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.949433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8ca4-6ac4-443a-bee4-d6f6572f755a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.949722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8ca4-6ac4-443a-bee4-d6f6572f755a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.950000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8ca4-6ac4-443a-bee4-d6f6572f755a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.951301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1576-3f4e-456c-a82e-46e0066f922d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:29.952027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 515/1036] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:29.956462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:29.956737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.957025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.957135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:29.957303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.957410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:29.957651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:29.958490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:29.958788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:29.960642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:29.976235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:29.977465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:29.980206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 522/1037] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:29.986175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:29.987212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 516/1038] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:29.996504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbdb6d-e3aa-4b3a-9022-8c262f94bc32 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.001279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.001990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.002338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.002672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.011150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.013006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.015674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.023183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 523/1039] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:45:30.024643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11eac-6b4a-4e81-9f76-b4f6114505db None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.028848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.030071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.030864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.031140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.031404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.032848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.034386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.036112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 517/1040] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:30.038344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d7f7e-e75f-4b8f-9b15-2f1f21658654 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.041545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.043249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.044024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.044308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.044620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.051525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a757ce-71d4-47a8-b19d-3afd2f4c2c99 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.055114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.056355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.057097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.057326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.057667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.058003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.058788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.060842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.073680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:30.082125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 524/1041] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:30.082125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.092919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab147ab-3e7d-4c9c-949a-7120c7f81e1f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.100126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.101276 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.101553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.101951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 518/1042] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:30 2022] POST /identity/v3/projects => generated 311 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:30.105041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.105906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:30.106219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.107961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.121415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 525/1043] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:30.127361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.191316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344c60-1735-4ca3-b4ef-8111782ea2ca admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.196413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.197268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.197550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.197777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.205786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.207812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.222035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:30.223517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 519/1044] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:30.229701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.240603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc1e2-e2c6-4ccb-91a2-8684cf0a9d5e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.246008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.246676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.246954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.247229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.248118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:30.248432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.250450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e523eb2-3f2d-436d-94a8-b331a2fa3055 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.264397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 526/1045] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:30.270653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:30.282361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228d94e-7bcd-4283-a70e-c18aa21802d7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:30.287057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:30.287712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:30.287986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:30.288253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:30.289143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] RBAC: Adding query filter params (role.id=2e17fc50fec34614bbe2995113778b72, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=a5e2802cd72344deb281b227f9acb3a0) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:30.289425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:30.291303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41eb7b-a06e-497b-b388-4fdab1e81658 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:30.297635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 520/1046] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:30 2022] GET /identity/v3/role_assignments?user.id=a5e2802cd72344deb281b227f9acb3a0&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=2e17fc50fec34614bbe2995113778b72 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:31.389747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dce27-64af-4458-8eea-88e64e9dd1e0 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:31.390263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dce27-64af-4458-8eea-88e64e9dd1e0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:31.390263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dce27-64af-4458-8eea-88e64e9dd1e0 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:31.392089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 527/1047] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:31.397452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:31.397859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:31.398174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:31.415907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:31.417120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:31.425604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 521/1048] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:31.447838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dce27-64af-4458-8eea-88e64e9dd1e0 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:31.460897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dce27-64af-4458-8eea-88e64e9dd1e0 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:31.465507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a259ef-96b4-4057-8f67-38a2cf63bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:31.466148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a259ef-96b4-4057-8f67-38a2cf63bb6c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:31.466443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a259ef-96b4-4057-8f67-38a2cf63bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:31.466712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a259ef-96b4-4057-8f67-38a2cf63bb6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:31.474560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a259ef-96b4-4057-8f67-38a2cf63bb6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:31.476326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a259ef-96b4-4057-8f67-38a2cf63bb6c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:31.485533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 528/1049] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:31.491660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:31.500621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744a23-542c-484d-b2f2-f61ef5ec91c0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:31.505706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773e08-4d80-410c-8b16-584892a4ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:31.506484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773e08-4d80-410c-8b16-584892a4ef31 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:31.506780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773e08-4d80-410c-8b16-584892a4ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:31.507040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773e08-4d80-410c-8b16-584892a4ef31 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:31.508248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773e08-4d80-410c-8b16-584892a4ef31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:31.510038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773e08-4d80-410c-8b16-584892a4ef31 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:31.512065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 522/1050] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:32.375748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a8a1e-4775-4f66-b065-37da68bc0287 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.375953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a8a1e-4775-4f66-b065-37da68bc0287 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.376191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a8a1e-4775-4f66-b065-37da68bc0287 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.378033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 529/1051] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:32.383397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5d579-77b7-487d-b0de-5bab566d095d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.383677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5d579-77b7-487d-b0de-5bab566d095d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.383945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5d579-77b7-487d-b0de-5bab566d095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.402087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c0b5d579-77b7-487d-b0de-5bab566d095d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:32.403258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c0b5d579-77b7-487d-b0de-5bab566d095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:32.411378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 523/1052] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:32.436268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a8a1e-4775-4f66-b065-37da68bc0287 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.447145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01fc71-8dd1-452b-9a16-dce74cca63ac None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.447426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01fc71-8dd1-452b-9a16-dce74cca63ac None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.447699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01fc71-8dd1-452b-9a16-dce74cca63ac None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.449476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 524/1053] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:45:32.450323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a8a1e-4775-4f66-b065-37da68bc0287 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.454281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.454550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.454820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.455633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.456446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.456733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.456986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.458263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.459956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.461744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 530/1054] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:32.467141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.472346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:32.473529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:32.477068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4804fc-a1b1-4f2f-b22f-f78ccd90919e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.481516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 525/1055] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:32.482406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.483164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.483440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.483705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.484427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.486713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.505176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.513412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 531/1056] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:45:32 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:45:32.514286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd2605-e965-4c7c-ad58-9716f4f22c8d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.519413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.520282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.520527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.520854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.533434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:32.543652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 03 02:45:32.545009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 526/1057] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:45:32.553292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.564168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f946-2a53-4606-a82f-3e7f7759fb73 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.570207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.570934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.571208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.571472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.572248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:32.572547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.574266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.583735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 532/1058] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:32.590019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.601157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b786-6fee-4891-b3fa-707170458795 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.606623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.607499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.607773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.608037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.620326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.622245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.642069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:32.643360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 527/1059] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:32.649611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.660459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94058-d0e8-414e-9682-c8e180faece0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.665632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.666303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.666580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.666844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.667582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:32.667873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.669621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.682549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 533/1060] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:32.688441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.698372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04df0c3-152b-498e-8e09-763b226ad00b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.703142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.703943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.704221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.704481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.711876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.713924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.727118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:45:32.728550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 528/1061] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:32.734384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.744827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cd63-9703-44bf-a25d-eca0df948445 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.749392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.750050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.750325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.750605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.751443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:32.751744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.753642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.770837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 534/1062] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:32.776447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.786157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8eb8-ba48-4c53-86f7-9c8f282c1b8a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.790673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.791433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.791700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.791963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.802046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.803868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.820077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:32.821222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 529/1063] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:32.827108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.837009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17c582-28e3-4d97-b07d-5bc318d11b22 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.841921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.842558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.842831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.843098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.843818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:32.844113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.845733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.857126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 535/1064] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:32.862957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.873370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725b04c-7a5a-4d92-89d3-97316f883f62 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.879390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.880173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.880446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.880755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.890833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.895073 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.910237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:32.911398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 530/1065] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:32.917529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.928255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cdb24-ec1c-46c0-ae0a-d69873296df0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.934038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.934681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.934996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.935263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.936075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:32.936360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.938254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bb5f-a1a8-471e-af2e-5cf4e89cd1ef admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.951932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 536/1066] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:32.958012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:32.969228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e25e90-a24a-432b-8364-a1e579028a04 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:32.974959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b71056-5081-46a4-8bd9-ca4965ea95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:32.975823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71056-5081-46a4-8bd9-ca4965ea95ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:32.976103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71056-5081-46a4-8bd9-ca4965ea95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:32.976366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71056-5081-46a4-8bd9-ca4965ea95ae admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/a5e2802cd72344deb281b227f9acb3a0/roles/2e17fc50fec34614bbe2995113778b72` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:32.979074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b71056-5081-46a4-8bd9-ca4965ea95ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=a5e2802cd72344deb281b227f9acb3a0, role_id=2e17fc50fec34614bbe2995113778b72)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:32.981855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b71056-5081-46a4-8bd9-ca4965ea95ae admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:32.997321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 531/1067] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:32 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/a5e2802cd72344deb281b227f9acb3a0/roles/2e17fc50fec34614bbe2995113778b72 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:45:34.730308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af392-434d-4684-88aa-6cf2e37fc68c None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:34.730903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af392-434d-4684-88aa-6cf2e37fc68c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:34.730903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af392-434d-4684-88aa-6cf2e37fc68c None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:34.732588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 537/1068] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:34.738479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:34.738905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:34.738989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:34.756546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:34.757748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:34.815066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 532/1069] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:34.838743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9af392-434d-4684-88aa-6cf2e37fc68c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:34.852098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9af392-434d-4684-88aa-6cf2e37fc68c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:34.857305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:34.858075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:34.858343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:34.858604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:34.869668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:34.876341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:34.877541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 538/1070] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:34.883811 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:34.893624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e0836-19d5-40d2-962b-ad52e88fb788 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:34.899761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:34.900479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:34.900757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:34.901040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:34.901854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:34.902154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:34.903938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:34.914176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 533/1071] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:34.920745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:34.931435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeac3c-22cb-4e29-a965-76aec8986d93 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:34.937278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:34.938139 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:34.938411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:34.938678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] PATH_INFO: `/v3/users/550e1fee0cb74e38b4d4eef33811e272` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:34.952951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] RBAC: Authorizing `identity:get_user(user_id=550e1fee0cb74e38b4d4eef33811e272)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:34.955096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:34.956961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 539/1072] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:34 2022] GET /identity/v3/users/550e1fee0cb74e38b4d4eef33811e272 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:34.962622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:34.972415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0d607-1c9f-4d4d-b69c-d7d9c3c5fba2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:34.977165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:34.977793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:34.978069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:34.978334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:34.986040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:34.988086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:34.996552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 534/1073] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:35.002138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.011824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4936-7e4c-4cbf-b7f2-a73274244639 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.016743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941cfd2-d74c-49df-b7ba-0a02a3dc5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.017589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941cfd2-d74c-49df-b7ba-0a02a3dc5546 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.017859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941cfd2-d74c-49df-b7ba-0a02a3dc5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.018121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941cfd2-d74c-49df-b7ba-0a02a3dc5546 admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.019401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941cfd2-d74c-49df-b7ba-0a02a3dc5546 admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb56a25e51a4c309a35b2a7fa9654cc)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.021494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941cfd2-d74c-49df-b7ba-0a02a3dc5546 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.023159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 540/1074] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:35.029079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.038018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7060d6-7241-41bd-bbd3-4769ab72c68c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.043035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.043663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.043943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.044191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.045164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc, user.id=550e1fee0cb74e38b4d4eef33811e272) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.045468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.047301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab81169-0d89-4173-96c4-ab1ea722934a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.052687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 535/1075] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/role_assignments?user.id=550e1fee0cb74e38b4d4eef33811e272&scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:35.153441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05ecd-32fa-4f41-8604-38e88c8d9d6e None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.153682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05ecd-32fa-4f41-8604-38e88c8d9d6e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.153984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05ecd-32fa-4f41-8604-38e88c8d9d6e None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.155781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 541/1076] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:35.161692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.162084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.162425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.182670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:35.183900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:35.193559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 536/1077] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:35.217384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05ecd-32fa-4f41-8604-38e88c8d9d6e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.230606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05ecd-32fa-4f41-8604-38e88c8d9d6e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.235348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.236201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.236815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.237082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.248251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:35.255321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 03 02:45:35.256503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 542/1078] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:35.262655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.272374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e5b61-a80e-42e8-95ad-4d455c14db86 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.278316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.279148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.279489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.279818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.280651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.280987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.282588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.290926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 537/1079] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:35.296778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.306668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d36a0-dfba-498d-bff1-106788a86070 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.312257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.313080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.313354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.313617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.325500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.327419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.344906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:35.346109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 543/1080] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:35.352000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.362820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca5816-eecb-4a54-bfdb-9ee0777feff1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.368547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.369229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.369504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.369763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.370494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.370792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.372365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.385118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 538/1081] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:35.390886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.400904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec0d0b-f39f-42a9-9a47-67f5387ca977 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.405927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.406717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.406998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.407250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.415444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.417536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.430518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 03 02:45:35.431657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 544/1082] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:35.437505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.447596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac45fc-5177-47e2-b01e-3338c2a20fd1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.453049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.453706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.453983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.454252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.455108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.455412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.457292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.474309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 539/1083] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:35.479850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.490000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aff548-b503-4155-bddd-dabeee3ccfa1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.494890 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.495515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.495793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.496046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.503919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.505827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.514879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 545/1084] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:35.520656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.530771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81b20-e14e-46e4-a8b7-faa5e988316f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.536086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.536899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.537174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.537437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.548509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.550382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.567174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:45:35.568431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 540/1085] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:35.573785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.582567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffccb9-de93-4343-b3ed-fd33ca01ef2d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.587510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.588143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.588420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.588692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.589461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.589761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.591489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.603818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 546/1086] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:35.609169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.619616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d50d-7775-4b86-a82c-0fba0f355725 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.625559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.626335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.626610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.626885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.634307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.636263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.649441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:45:35.650620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 541/1087] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:35.656593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.667109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e1a2d-a1a6-41aa-83a1-a8b8de2caac1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.672958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.673606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.673886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.674154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.674953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.675255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.677149 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97224-40ff-4167-bfb0-dcefb03d4584 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.689732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 547/1088] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:35.695856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:35.707114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962c97-6d01-4b40-9d16-289d238fc359 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:35.712398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:35.713062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:35.713342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:35.713609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:35.714445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] RBAC: Adding query filter params (role.id=2e17fc50fec34614bbe2995113778b72, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=a5e2802cd72344deb281b227f9acb3a0) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:35.714785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:35.716662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f194aa-b6dc-4e78-866e-bd922c2fd2b2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:35.722862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 542/1089] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:35 2022] GET /identity/v3/role_assignments?user.id=a5e2802cd72344deb281b227f9acb3a0&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=2e17fc50fec34614bbe2995113778b72 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:37.197968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd919d1-0d9d-4476-9d46-7bd7636402da None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.198762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd919d1-0d9d-4476-9d46-7bd7636402da None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.198924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd919d1-0d9d-4476-9d46-7bd7636402da None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.201500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 548/1090] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:37.207020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.207411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.207572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.227826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:37.229058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:37.239357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 543/1091] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:37.262686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd919d1-0d9d-4476-9d46-7bd7636402da None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:37.285234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd919d1-0d9d-4476-9d46-7bd7636402da None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:37.293749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:37.294864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.295141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.295408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.306070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:37.313572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:37.314727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 549/1092] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:37.320526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:37.330259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0490-c8db-4149-a479-72422ce4abfc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:37.336802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:37.337428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.337699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.337959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.338721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:37.339015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:37.340601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:37.350015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 544/1093] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:37.355718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:37.374947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6bc09-33ff-4549-9538-a67a4399bf21 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:37.384326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:37.385654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.386012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.386393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] PATH_INFO: `/v3/users/550e1fee0cb74e38b4d4eef33811e272` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.388429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] RBAC: Authorizing `identity:get_user(user_id=550e1fee0cb74e38b4d4eef33811e272)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:37.390619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:37.392189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 550/1094] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:37 2022] GET /identity/v3/users/550e1fee0cb74e38b4d4eef33811e272 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:37.400806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:37.416288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924155-2612-4052-a7f6-adee9e9d9a4b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:37.423609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa210d99-083b-4e13-a7e5-1c1aab2dd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:37.424420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa210d99-083b-4e13-a7e5-1c1aab2dd3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.424738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa210d99-083b-4e13-a7e5-1c1aab2dd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.425010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa210d99-083b-4e13-a7e5-1c1aab2dd3c4 admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.426394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa210d99-083b-4e13-a7e5-1c1aab2dd3c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb56a25e51a4c309a35b2a7fa9654cc)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:37.428419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa210d99-083b-4e13-a7e5-1c1aab2dd3c4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:37.430052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 545/1095] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:37 2022] GET /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:37.435324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:37.444934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793389e-0222-42ac-88ea-2b1f2e0c55fb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:37.450307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43f206-6a0a-42e3-8393-4a4de273eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:37.451179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f206-6a0a-42e3-8393-4a4de273eb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:37.451453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f206-6a0a-42e3-8393-4a4de273eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:37.451720 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f206-6a0a-42e3-8393-4a4de273eb9b admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc/users/550e1fee0cb74e38b4d4eef33811e272/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:37.454134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f206-6a0a-42e3-8393-4a4de273eb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb56a25e51a4c309a35b2a7fa9654cc, user_id=550e1fee0cb74e38b4d4eef33811e272, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:37.456707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f206-6a0a-42e3-8393-4a4de273eb9b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:37.472916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 551/1096] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:37 2022] PUT /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc/users/550e1fee0cb74e38b4d4eef33811e272/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:45:39.610229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7cd8-a9eb-457c-a64c-c929e2b6ebeb None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.611086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7cd8-a9eb-457c-a64c-c929e2b6ebeb None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.611086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7cd8-a9eb-457c-a64c-c929e2b6ebeb None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.614384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 546/1097] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:39.619855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.620289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.620381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.639927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:39.641144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:39.698899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 552/1098] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:39.731243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7cd8-a9eb-457c-a64c-c929e2b6ebeb None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:39.753582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7cd8-a9eb-457c-a64c-c929e2b6ebeb None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:39.762986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:39.763808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.764080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.764346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.777300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:39.784074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:39.785276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 547/1099] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:39.794841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:39.809305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc494b-1a8c-4fc1-aaad-d6b98f5a6ce3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:39.815820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:39.816482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.816747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.817065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.817829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:39.818128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:39.819747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:39.828321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 553/1100] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:39.833920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:39.844059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad193c7-09d9-4b17-b584-3c4e5c991ad1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:39.850167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:39.851006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.851279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.851546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] PATH_INFO: `/v3/users/550e1fee0cb74e38b4d4eef33811e272` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.853006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] RBAC: Authorizing `identity:get_user(user_id=550e1fee0cb74e38b4d4eef33811e272)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:39.855121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:39.856699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 548/1101] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:39 2022] GET /identity/v3/users/550e1fee0cb74e38b4d4eef33811e272 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:39.864790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:39.874494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62089-ec79-453d-b4ec-e470c81511ac admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:39.879900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:39.880506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.880815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.881092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.889129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:39.890828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:39.899730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 554/1102] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:45:39.905293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:39.915905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bc365-e53d-4d52-8c67-e802818cb604 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:39.922353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417e1aa-7f44-4578-b09e-43036822c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:39.923147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417e1aa-7f44-4578-b09e-43036822c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.923452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417e1aa-7f44-4578-b09e-43036822c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.923721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417e1aa-7f44-4578-b09e-43036822c9ce admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.925023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417e1aa-7f44-4578-b09e-43036822c9ce admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb56a25e51a4c309a35b2a7fa9654cc)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:39.927017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417e1aa-7f44-4578-b09e-43036822c9ce admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:39.928613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 549/1103] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:39 2022] GET /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:39.934181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:39.947507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15cb4e-4c39-47e1-ac3a-4af58c80d1a2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:39.956684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:39.957591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:39.957905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:39.958244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:39.959466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc, user.id=550e1fee0cb74e38b4d4eef33811e272) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:39.959828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:39.962666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a55985-2164-40ca-b46b-1382caf4fb0e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:39.970259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 555/1104] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:39 2022] GET /identity/v3/role_assignments?user.id=550e1fee0cb74e38b4d4eef33811e272&scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:42.158958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b8ec-0311-4ffd-a3ae-50c947fcb7a1 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:42.159544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b8ec-0311-4ffd-a3ae-50c947fcb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:42.159544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b8ec-0311-4ffd-a3ae-50c947fcb7a1 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:42.161336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 550/1105] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:42.167740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:42.168457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:42.168635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:42.193061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:42.194248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:42.203318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 556/1106] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:42.229871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b8ec-0311-4ffd-a3ae-50c947fcb7a1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:42.243737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b8ec-0311-4ffd-a3ae-50c947fcb7a1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:42.249153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7979202-d7e0-4188-9ea3-37fe9a1f62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:42.249929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7979202-d7e0-4188-9ea3-37fe9a1f62e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:42.250207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7979202-d7e0-4188-9ea3-37fe9a1f62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:42.250480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7979202-d7e0-4188-9ea3-37fe9a1f62e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:42.251790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7979202-d7e0-4188-9ea3-37fe9a1f62e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:42.253525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7979202-d7e0-4188-9ea3-37fe9a1f62e1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:42.255096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 551/1107] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:42.261388 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:42.275830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11c445-13b5-439e-85ec-fc7207e69f1f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:42.282667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbf7f-5130-4105-a492-a15120aa887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:42.283322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbf7f-5130-4105-a492-a15120aa887f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:42.283601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbf7f-5130-4105-a492-a15120aa887f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:42.283869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbf7f-5130-4105-a492-a15120aa887f admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:42.284589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcbf7f-5130-4105-a492-a15120aa887f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:42.286544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcbf7f-5130-4105-a492-a15120aa887f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:42.311505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 557/1108] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:45:42 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:44.527784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be126-38dc-4ec1-9e87-41b8954800e9 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.528482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be126-38dc-4ec1-9e87-41b8954800e9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.528482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be126-38dc-4ec1-9e87-41b8954800e9 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.530214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 552/1109] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:44.539154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.539864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.540084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.566235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:44.567418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:44.575575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 558/1110] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:44.599551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be126-38dc-4ec1-9e87-41b8954800e9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:44.613594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be126-38dc-4ec1-9e87-41b8954800e9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:44.618457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:44.619291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.619568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.619836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] PATH_INFO: `/v3/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.621332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] RBAC: Authorizing `identity:get_role(role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:44.622399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:44.622399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:45:44.622399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:45:44.623273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:44.624568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 553/1111] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:44 2022] GET /identity/v3/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:44.630451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:44.645058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de9d1b-183e-4958-ae36-00bc085dad8d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:44.653688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:44.654543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.654817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.655086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] PATH_INFO: `/v3/users/472084449fdd4b8c93d9590596858565` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.669609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] RBAC: Authorizing `identity:get_user(user_id=472084449fdd4b8c93d9590596858565)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:44.671765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:44.673377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 559/1112] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:44 2022] GET /identity/v3/users/472084449fdd4b8c93d9590596858565 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:44.679060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:44.688749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765dfb0-f854-48d2-8934-340a944c9463 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:44.693284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:44.693920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.694194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.694462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.702361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:44.704067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:44.712854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 554/1113] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:44.718591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:44.729439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9627190-3ae6-4588-9094-3905e2675d59 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:44.736444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9c9a0-9b73-4d16-af60-343d11ce7c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:44.737324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9c9a0-9b73-4d16-af60-343d11ce7c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.737601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9c9a0-9b73-4d16-af60-343d11ce7c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.737870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9c9a0-9b73-4d16-af60-343d11ce7c94 admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.739267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9c9a0-9b73-4d16-af60-343d11ce7c94 admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb56a25e51a4c309a35b2a7fa9654cc)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:44.741325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9c9a0-9b73-4d16-af60-343d11ce7c94 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:44.742935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 560/1114] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:44 2022] GET /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:44.748807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:44.757277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75d2f8-d845-4dfb-bea0-d48a51cd563d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:44.763113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:44.763709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:44.763983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:44.764253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:44.765120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] RBAC: Adding query filter params (role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc, user.id=472084449fdd4b8c93d9590596858565) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:44.765425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:44.767200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105d72-32eb-4f18-9b03-a7c12fb73c63 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:44.772598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 555/1115] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:44 2022] GET /identity/v3/role_assignments?user.id=472084449fdd4b8c93d9590596858565&scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:46.932412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b01b-f279-47a5-8c16-104c120c2bb5 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:46.933024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b01b-f279-47a5-8c16-104c120c2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:46.933024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b01b-f279-47a5-8c16-104c120c2bb5 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:46.935799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 561/1116] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:46.944593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a430-193e-432b-9a42-940456fba51b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:46.945040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a430-193e-432b-9a42-940456fba51b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:46.945188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a430-193e-432b-9a42-940456fba51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:46.966765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d761a430-193e-432b-9a42-940456fba51b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:46.967966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d761a430-193e-432b-9a42-940456fba51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:46.975899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 556/1117] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:46.999412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b01b-f279-47a5-8c16-104c120c2bb5 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:47.014645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b01b-f279-47a5-8c16-104c120c2bb5 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:47.020039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:47.020904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:47.021181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:47.021449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] PATH_INFO: `/v3/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:47.022949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] RBAC: Authorizing `identity:get_role(role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:47.024004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:45:47.024004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:45:47.024004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:45:47.024906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:47.026196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 562/1118] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:46 2022] GET /identity/v3/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:47.032336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761a430-193e-432b-9a42-940456fba51b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:47.046012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761a430-193e-432b-9a42-940456fba51b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:47.051928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:47.052781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:47.053089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:47.053355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] PATH_INFO: `/v3/users/472084449fdd4b8c93d9590596858565` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:47.054723 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=472084449fdd4b8c93d9590596858565)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:47.056882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:47.058445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 557/1119] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:47 2022] GET /identity/v3/users/472084449fdd4b8c93d9590596858565 => generated 286 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:45:47.063738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:47.073874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f36fff-9e43-4c85-9081-3a52d47ff12c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:47.080233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f097a-b993-4c30-a53c-7fba6d9961c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:47.081101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f097a-b993-4c30-a53c-7fba6d9961c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:47.081378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f097a-b993-4c30-a53c-7fba6d9961c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:47.081645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f097a-b993-4c30-a53c-7fba6d9961c7 admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:47.083032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f097a-b993-4c30-a53c-7fba6d9961c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb56a25e51a4c309a35b2a7fa9654cc)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:47.085087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f097a-b993-4c30-a53c-7fba6d9961c7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:47.086699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 563/1120] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:47 2022] GET /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:47.092699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:47.103246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1f97-1b25-43aa-9409-6a2e75009fe2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:47.108624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce167c-bbf7-416a-9818-6a0d6aa7cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:47.109524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce167c-bbf7-416a-9818-6a0d6aa7cbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:47.109798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce167c-bbf7-416a-9818-6a0d6aa7cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:47.110077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce167c-bbf7-416a-9818-6a0d6aa7cbe4 admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc/users/472084449fdd4b8c93d9590596858565/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:47.112897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce167c-bbf7-416a-9818-6a0d6aa7cbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb56a25e51a4c309a35b2a7fa9654cc, user_id=472084449fdd4b8c93d9590596858565, role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:47.115504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce167c-bbf7-416a-9818-6a0d6aa7cbe4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:47.130479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 558/1121] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:47 2022] PUT /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc/users/472084449fdd4b8c93d9590596858565/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:45:49.328506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26493e9-135f-436a-9230-6bed4ca3e4ea None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.329132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26493e9-135f-436a-9230-6bed4ca3e4ea None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.329132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26493e9-135f-436a-9230-6bed4ca3e4ea None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.330896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 564/1122] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:49.336539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.336988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.337088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.357671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:49.358850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:49.417000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 559/1123] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:49.441471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26493e9-135f-436a-9230-6bed4ca3e4ea None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:49.459625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26493e9-135f-436a-9230-6bed4ca3e4ea None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:49.465762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:49.466600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.466874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.467143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] PATH_INFO: `/v3/roles/6ebcd5b285e14ed9a7e22e247f0e9818` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.468755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] RBAC: Authorizing `identity:get_role(role_id=6ebcd5b285e14ed9a7e22e247f0e9818)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:49.470354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:49.471651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 565/1124] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:49 2022] GET /identity/v3/roles/6ebcd5b285e14ed9a7e22e247f0e9818 => generated 223 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:49.477035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:49.486931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce90bc0-2b1a-465c-9134-b143b3bb720d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:49.493666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:49.494890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.495190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.495478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] PATH_INFO: `/v3/users/472084449fdd4b8c93d9590596858565` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.497570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=472084449fdd4b8c93d9590596858565)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:49.500711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:49.503102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 560/1125] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:49 2022] GET /identity/v3/users/472084449fdd4b8c93d9590596858565 => generated 286 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:49.511214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:49.521162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec76af-1f4e-44f3-ae79-8d7bd679049c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:49.526893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:49.527485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.527762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.528022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.536226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:49.537953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:49.547103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 566/1126] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:49.553016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:49.563509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e285f7a-2b48-4a93-96e0-e2339ae720b1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:49.569128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48459-2d72-49f5-8539-ad04b9258477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:49.569943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48459-2d72-49f5-8539-ad04b9258477 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.570214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48459-2d72-49f5-8539-ad04b9258477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.570483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48459-2d72-49f5-8539-ad04b9258477 admin admin] PATH_INFO: `/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.571775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48459-2d72-49f5-8539-ad04b9258477 admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb56a25e51a4c309a35b2a7fa9654cc)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:49.573831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48459-2d72-49f5-8539-ad04b9258477 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:49.575433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 561/1127] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:49 2022] GET /identity/v3/projects/0cb56a25e51a4c309a35b2a7fa9654cc => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:49.581706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:49.594838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c26e8d-8d67-4ac0-9f2e-f2b7541872ac admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:49.600545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:49.601203 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:49.601484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:49.601758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:49.602584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] RBAC: Adding query filter params (role.id=6ebcd5b285e14ed9a7e22e247f0e9818, scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc, user.id=472084449fdd4b8c93d9590596858565) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:49.602891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:49.604739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66579-9741-425e-afd9-3669a733b45f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:49.611880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 567/1128] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:49 2022] GET /identity/v3/role_assignments?user.id=472084449fdd4b8c93d9590596858565&scope.project.id=0cb56a25e51a4c309a35b2a7fa9654cc&role.id=6ebcd5b285e14ed9a7e22e247f0e9818 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:51.767214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e255-d4f9-4d3d-8e4d-877896923b50 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:51.767775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e255-d4f9-4d3d-8e4d-877896923b50 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:51.767775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e255-d4f9-4d3d-8e4d-877896923b50 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:51.769577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 562/1129] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:51.775895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:51.776610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:51.776806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:51.795734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:51.796957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:51.805821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 568/1130] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:51.829655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e255-d4f9-4d3d-8e4d-877896923b50 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:51.843324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e255-d4f9-4d3d-8e4d-877896923b50 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:51.848324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7473429-cb0d-474d-a1d3-5f7e9fff6569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:51.849125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7473429-cb0d-474d-a1d3-5f7e9fff6569 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:51.849395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7473429-cb0d-474d-a1d3-5f7e9fff6569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:51.849655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7473429-cb0d-474d-a1d3-5f7e9fff6569 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:51.850969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7473429-cb0d-474d-a1d3-5f7e9fff6569 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:51.852638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7473429-cb0d-474d-a1d3-5f7e9fff6569 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:51.854178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 563/1131] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:51.860146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:51.874097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06198-8cfe-4e7a-a073-ba613268136f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:51.879951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067348b-61ab-4cfe-ab8a-fb85e6733e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:51.880594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067348b-61ab-4cfe-ab8a-fb85e6733e41 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:51.880911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067348b-61ab-4cfe-ab8a-fb85e6733e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:51.881185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067348b-61ab-4cfe-ab8a-fb85e6733e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:51.881909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067348b-61ab-4cfe-ab8a-fb85e6733e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:51.883809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067348b-61ab-4cfe-ab8a-fb85e6733e41 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:51.913321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 569/1132] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:45:51 2022] POST /identity/v3/projects => generated 311 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:45:54.108652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740682e-2178-4a31-ad32-4546ad4f1082 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:54.109300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740682e-2178-4a31-ad32-4546ad4f1082 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:54.109411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740682e-2178-4a31-ad32-4546ad4f1082 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:54.112606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 564/1133] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:54.120535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:54.121009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:54.121100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:54.141290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:54.142464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:54.204065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 570/1134] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:45:54.233845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740682e-2178-4a31-ad32-4546ad4f1082 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:54.248999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740682e-2178-4a31-ad32-4546ad4f1082 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:54.254411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c268a6-6c6f-4359-9516-2d45ad0f1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:54.255176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c268a6-6c6f-4359-9516-2d45ad0f1423 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:54.255449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c268a6-6c6f-4359-9516-2d45ad0f1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:54.255715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c268a6-6c6f-4359-9516-2d45ad0f1423 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:54.257033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c268a6-6c6f-4359-9516-2d45ad0f1423 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:54.258710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c268a6-6c6f-4359-9516-2d45ad0f1423 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:54.260261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 565/1135] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:45:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:54.266431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:54.280086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facab1ce-837e-40ef-aa00-96ec802b47c4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:54.285989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2832fca-7fb1-4848-a0e3-f91217ef46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:54.286640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2832fca-7fb1-4848-a0e3-f91217ef46b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:54.286916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2832fca-7fb1-4848-a0e3-f91217ef46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:54.287180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2832fca-7fb1-4848-a0e3-f91217ef46b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:54.287898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2832fca-7fb1-4848-a0e3-f91217ef46b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:54.289859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2832fca-7fb1-4848-a0e3-f91217ef46b4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:54.311526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 571/1136] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:45:54 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:45:56.516502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8dca-6d65-4451-87b3-cb462c6fcbe7 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.517486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8dca-6d65-4451-87b3-cb462c6fcbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.517486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8dca-6d65-4451-87b3-cb462c6fcbe7 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.520284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 566/1137] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:56.525832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.526260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.526365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.544969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:56.546142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:56.554509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 572/1138] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:56.578418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8dca-6d65-4451-87b3-cb462c6fcbe7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:56.597397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8dca-6d65-4451-87b3-cb462c6fcbe7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:56.603556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:56.604320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.604594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.604901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.616884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:56.623513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:56.624644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 567/1139] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:56.640486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:56.657786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e6540-9793-4051-b79e-ba85dca8cb0e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:56.665646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:56.666613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.666980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.667321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.668555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:56.668924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:56.670527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:56.680262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 573/1140] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:56.687051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:56.702855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750781b-a376-4434-965e-213d67e79ac1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:56.709041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:56.709899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.710174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.710434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] PATH_INFO: `/v3/users/1bffad494fde40f2b7f7803a4d3b9dae` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.726571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=1bffad494fde40f2b7f7803a4d3b9dae)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:56.728756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:56.730357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 568/1141] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:56 2022] GET /identity/v3/users/1bffad494fde40f2b7f7803a4d3b9dae => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:56.739385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:56.755120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11663-27c3-4b3d-8cca-656f7127bbcb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:56.763524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:56.764151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.764421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.764687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.772620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:56.774320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:56.783044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 574/1142] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:45:56 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:45:56.789124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:56.800970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3b826-7bac-4fe9-a669-7b54c69423e7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:56.806847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb2db-bf95-497b-9e88-09d27652f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:56.807664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb2db-bf95-497b-9e88-09d27652f704 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.807943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb2db-bf95-497b-9e88-09d27652f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.808208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb2db-bf95-497b-9e88-09d27652f704 admin admin] PATH_INFO: `/v3/projects/0af2d114a6374f5694054638157e4d40` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.809547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddb2db-bf95-497b-9e88-09d27652f704 admin admin] RBAC: Authorizing `identity:get_project(project_id=0af2d114a6374f5694054638157e4d40)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:56.811553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddb2db-bf95-497b-9e88-09d27652f704 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:56.813184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 569/1143] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:56 2022] GET /identity/v3/projects/0af2d114a6374f5694054638157e4d40 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:56.818615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:56.827309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76414-11e9-4efd-9a73-1474b8566b36 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:56.832219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:56.832839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:56.833116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:56.833377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:56.834180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=0af2d114a6374f5694054638157e4d40, user.id=1bffad494fde40f2b7f7803a4d3b9dae) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:56.834477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:56.836230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c21ced-79bc-4aea-b0ef-9c183f43614c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:56.841684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 575/1144] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:45:56 2022] GET /identity/v3/role_assignments?user.id=1bffad494fde40f2b7f7803a4d3b9dae&scope.project.id=0af2d114a6374f5694054638157e4d40&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:58.973975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27974ff-d521-406a-8c89-46ed9a925610 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:58.974530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27974ff-d521-406a-8c89-46ed9a925610 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:58.974530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27974ff-d521-406a-8c89-46ed9a925610 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:58.977295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 570/1145] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:45:58.985232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:58.985629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:58.986147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:59.013939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:45:59.015162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:45:59.023324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 576/1146] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:45:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:45:59.053978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27974ff-d521-406a-8c89-46ed9a925610 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:59.069328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27974ff-d521-406a-8c89-46ed9a925610 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:59.075393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:59.076153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:59.076421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:59.076683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:59.089215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:45:59.100144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:45:59.101887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 571/1147] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:45:59.107927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:59.117775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652f11e-7d81-4896-a184-0cc02124855a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:59.123612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:59.124262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:59.124540 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:59.124847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:59.125604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:45:59.125901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:59.127511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:59.136303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 577/1148] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:59.144314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:59.160862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce63e3-f15e-40f4-a72b-57418deeeda7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:59.169780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:59.170606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:59.170876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:59.171137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] PATH_INFO: `/v3/users/1bffad494fde40f2b7f7803a4d3b9dae` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:59.172554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] RBAC: Authorizing `identity:get_user(user_id=1bffad494fde40f2b7f7803a4d3b9dae)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:59.174701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:59.176230 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 572/1149] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:45:59 2022] GET /identity/v3/users/1bffad494fde40f2b7f7803a4d3b9dae => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:59.183406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:59.194938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37ef18-58f9-4590-b6fa-b96acdcf85ec admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:59.201169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4336-51a9-4b17-8bd6-659e272a4805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:59.201998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4336-51a9-4b17-8bd6-659e272a4805 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:59.202274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4336-51a9-4b17-8bd6-659e272a4805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:59.202542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4336-51a9-4b17-8bd6-659e272a4805 admin admin] PATH_INFO: `/v3/projects/0af2d114a6374f5694054638157e4d40` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:59.203934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4336-51a9-4b17-8bd6-659e272a4805 admin admin] RBAC: Authorizing `identity:get_project(project_id=0af2d114a6374f5694054638157e4d40)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:59.205999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4336-51a9-4b17-8bd6-659e272a4805 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:59.207632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 578/1150] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:45:59 2022] GET /identity/v3/projects/0af2d114a6374f5694054638157e4d40 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:45:59.216869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:45:59.232744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3807f4-9f66-4b28-af4e-465a44932501 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:45:59.238855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78716fc-d3ff-4343-ad52-255047ab80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:45:59.239713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78716fc-d3ff-4343-ad52-255047ab80c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:45:59.239984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78716fc-d3ff-4343-ad52-255047ab80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:45:59.240249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78716fc-d3ff-4343-ad52-255047ab80c9 admin admin] PATH_INFO: `/v3/projects/0af2d114a6374f5694054638157e4d40/users/1bffad494fde40f2b7f7803a4d3b9dae/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:45:59.242349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78716fc-d3ff-4343-ad52-255047ab80c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af2d114a6374f5694054638157e4d40, user_id=1bffad494fde40f2b7f7803a4d3b9dae, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:45:59.244952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78716fc-d3ff-4343-ad52-255047ab80c9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:45:59.259877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 573/1151] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:45:59 2022] PUT /identity/v3/projects/0af2d114a6374f5694054638157e4d40/users/1bffad494fde40f2b7f7803a4d3b9dae/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:46:01.390600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840977-e44e-4613-a54d-d3b8acea8e58 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.391515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840977-e44e-4613-a54d-d3b8acea8e58 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.391515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840977-e44e-4613-a54d-d3b8acea8e58 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.394402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 579/1152] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:01.399813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.400251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.400345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.419767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:01.420973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:01.478273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 574/1153] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:01.502758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840977-e44e-4613-a54d-d3b8acea8e58 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:01.517678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840977-e44e-4613-a54d-d3b8acea8e58 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:01.522285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:01.523055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.523333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.523596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.533795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:46:01.540407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:46:01.541593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 580/1154] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:46:01.547560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:01.556552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8fe0-f717-49b6-8aad-41dc3c641573 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:01.561908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:01.562551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.562826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.563089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.563851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:01.564143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:01.565784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:01.574759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 575/1155] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:01.580943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:01.595534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbb238-c0fb-40ae-bd2a-ed2244930bdd admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:01.602048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:01.602872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.603141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.603408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] PATH_INFO: `/v3/users/1bffad494fde40f2b7f7803a4d3b9dae` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.604847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] RBAC: Authorizing `identity:get_user(user_id=1bffad494fde40f2b7f7803a4d3b9dae)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:01.606974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:01.608525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 581/1156] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:46:01 2022] GET /identity/v3/users/1bffad494fde40f2b7f7803a4d3b9dae => generated 286 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:01.614303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:01.623947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53caad-75d1-49db-b4e2-a30fe25b60ce admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:01.628898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:01.629495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.629721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.630023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.637803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:01.639517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:01.648297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 576/1157] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:46:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:46:01.653693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:01.664159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a1c0-bb34-4f38-a941-0329fcd01bfe admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:01.669908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3576a-e4c1-48aa-ae08-83e59ab88e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:01.670699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3576a-e4c1-48aa-ae08-83e59ab88e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.670971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3576a-e4c1-48aa-ae08-83e59ab88e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.671235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3576a-e4c1-48aa-ae08-83e59ab88e8e admin admin] PATH_INFO: `/v3/projects/0af2d114a6374f5694054638157e4d40` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.672511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3576a-e4c1-48aa-ae08-83e59ab88e8e admin admin] RBAC: Authorizing `identity:get_project(project_id=0af2d114a6374f5694054638157e4d40)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:01.674533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3576a-e4c1-48aa-ae08-83e59ab88e8e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:01.676109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 582/1158] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:46:01 2022] GET /identity/v3/projects/0af2d114a6374f5694054638157e4d40 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:01.681493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:01.690215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd988a-4854-4a62-89bf-dbe1c243a660 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:01.695213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:01.695814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:01.696086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:01.696363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:01.697222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=0af2d114a6374f5694054638157e4d40, user.id=1bffad494fde40f2b7f7803a4d3b9dae) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:01.697528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:01.699295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefe35c-73b2-4f86-ac45-33109c155375 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:01.705119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 577/1159] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:46:01 2022] GET /identity/v3/role_assignments?user.id=1bffad494fde40f2b7f7803a4d3b9dae&scope.project.id=0af2d114a6374f5694054638157e4d40&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:03.876074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25594d-025a-4174-b5b7-dc35e6c0f31c None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:03.876981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25594d-025a-4174-b5b7-dc35e6c0f31c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:03.876981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25594d-025a-4174-b5b7-dc35e6c0f31c None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:03.879829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 583/1160] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:03.885394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:03.885832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:03.885932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:03.905386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:03.906551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:03.915535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 578/1161] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:03.938585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25594d-025a-4174-b5b7-dc35e6c0f31c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:03.961626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25594d-025a-4174-b5b7-dc35e6c0f31c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:03.969358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:03.969983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:03.970265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:03.970534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:03.978992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:03.980772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:03.990423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 584/1162] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:46:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:46:03.996151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:04.005213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990606c-3446-4a8b-815a-35d0653cf7b1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:04.011431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:04.012219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:04.012492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:04.012762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:04.020145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:04.022020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:04.035958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-8b6212fa-9286-4d8a-8502-e269d1104667 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 03 02:46:04.037110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 579/1163] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:46:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:46:04.043558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:04.058557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391fd4-ac4b-40d8-b527-e81d31622eba admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:04.065530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:04.066160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:04.066451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:04.066708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:04.067404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:04.067711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:04.069324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e704d-ae96-4da9-b229-8d60c4873123 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:04.077066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 585/1164] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 3 02:46:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:46:06.226925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285feb8-679c-4c37-a1aa-2e9179af3cd7 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:06.227492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285feb8-679c-4c37-a1aa-2e9179af3cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:06.227492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285feb8-679c-4c37-a1aa-2e9179af3cd7 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:06.229280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 580/1165] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:06.236191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec1dd-2d77-4a58-83f9-00105a710550 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:06.236973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec1dd-2d77-4a58-83f9-00105a710550 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:06.237122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec1dd-2d77-4a58-83f9-00105a710550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:06.259710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f9fec1dd-2d77-4a58-83f9-00105a710550 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:06.260949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f9fec1dd-2d77-4a58-83f9-00105a710550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:06.271053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 586/1166] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:06.293999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285feb8-679c-4c37-a1aa-2e9179af3cd7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:06.307596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285feb8-679c-4c37-a1aa-2e9179af3cd7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:06.313254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:06.313888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:06.314166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:06.314434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:06.315196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:06.316221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:46:06.316221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:46:06.316221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:46:06.317135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38257748-da26-44cb-97b3-ded2dc771d17 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:06.341800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 581/1167] 10.222.0.31 () {60 vars in 1159 bytes} [Thu Feb 3 02:46:06 2022] POST /identity/v3/domains => generated 267 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:46:08.514999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60572190-95ba-432f-a825-d7a46c2a8cc8 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:08.515594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60572190-95ba-432f-a825-d7a46c2a8cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:08.515594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60572190-95ba-432f-a825-d7a46c2a8cc8 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:08.517377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 587/1168] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:08.523858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:08.524576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:08.524693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:08.544368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:08.545602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:08.608324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 582/1169] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:08.632359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60572190-95ba-432f-a825-d7a46c2a8cc8 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:08.647591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60572190-95ba-432f-a825-d7a46c2a8cc8 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:08.653678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f7b4b-ea87-4a0b-afd6-30088e532f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:08.654514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7b4b-ea87-4a0b-afd6-30088e532f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:08.654789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7b4b-ea87-4a0b-afd6-30088e532f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:08.655058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7b4b-ea87-4a0b-afd6-30088e532f9e admin admin] PATH_INFO: `/v3/domains/3f0f40848b46442daa7728bf37b0d4e2` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:08.667252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f7b4b-ea87-4a0b-afd6-30088e532f9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3f0f40848b46442daa7728bf37b0d4e2)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:08.669343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f7b4b-ea87-4a0b-afd6-30088e532f9e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:08.670916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 588/1170] 10.222.0.31 () {56 vars in 1204 bytes} [Thu Feb 3 02:46:08 2022] GET /identity/v3/domains/3f0f40848b46442daa7728bf37b0d4e2 => generated 267 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:08.676623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:08.689022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb88ab7-29a1-4a24-beee-1a0c19ea913c None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:08.697484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b17c0-6c60-4ec9-9ab9-ca2038bed719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:08.698455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b17c0-6c60-4ec9-9ab9-ca2038bed719 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:08.698865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b17c0-6c60-4ec9-9ab9-ca2038bed719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:08.699260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b17c0-6c60-4ec9-9ab9-ca2038bed719 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:08.700244 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b17c0-6c60-4ec9-9ab9-ca2038bed719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:08.702167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b17c0-6c60-4ec9-9ab9-ca2038bed719 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:08.729784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 583/1171] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:46:08 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:46:10.898345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5ebf9-f43b-4ea4-8b3b-41d294ea5a91 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:10.899267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5ebf9-f43b-4ea4-8b3b-41d294ea5a91 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:10.899267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5ebf9-f43b-4ea4-8b3b-41d294ea5a91 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:10.902197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 589/1172] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:10.910752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:10.911190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:10.911306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:10.932660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:10.933874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:10.994369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 584/1173] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:11.026541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5ebf9-f43b-4ea4-8b3b-41d294ea5a91 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:11.040672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5ebf9-f43b-4ea4-8b3b-41d294ea5a91 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:11.046556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f976816-eded-40f1-acfe-8b3c98ab63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:11.047401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f976816-eded-40f1-acfe-8b3c98ab63e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:11.047683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f976816-eded-40f1-acfe-8b3c98ab63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:11.047949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f976816-eded-40f1-acfe-8b3c98ab63e0 admin admin] PATH_INFO: `/v3/domains/3f0f40848b46442daa7728bf37b0d4e2` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:11.049305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f976816-eded-40f1-acfe-8b3c98ab63e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3f0f40848b46442daa7728bf37b0d4e2)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:11.051277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f976816-eded-40f1-acfe-8b3c98ab63e0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:11.052882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 590/1174] 10.222.0.31 () {56 vars in 1204 bytes} [Thu Feb 3 02:46:11 2022] GET /identity/v3/domains/3f0f40848b46442daa7728bf37b0d4e2 => generated 267 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:11.058787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:11.070980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ef3d-b7a3-4826-be3d-274260407618 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:11.078102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9917471-8b90-490d-8172-c8a5fa1ab266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:11.078765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9917471-8b90-490d-8172-c8a5fa1ab266 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:11.079039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9917471-8b90-490d-8172-c8a5fa1ab266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:11.079304 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9917471-8b90-490d-8172-c8a5fa1ab266 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:11.080034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9917471-8b90-490d-8172-c8a5fa1ab266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:11.081994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9917471-8b90-490d-8172-c8a5fa1ab266 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:11.106339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 585/1175] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:46:11 2022] POST /identity/v3/users => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:46:13.278637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99e5f1-e48a-4173-b991-46c214dc540b None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.279576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99e5f1-e48a-4173-b991-46c214dc540b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.279576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99e5f1-e48a-4173-b991-46c214dc540b None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.282486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 591/1176] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:13.287915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.288361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.288465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.307421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:13.308577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:13.316828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 586/1177] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:13.340461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99e5f1-e48a-4173-b991-46c214dc540b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:13.355945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99e5f1-e48a-4173-b991-46c214dc540b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:13.361751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:13.362524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.362794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.363101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.373938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:46:13.380578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:46:13.381742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 592/1178] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:46:13.388182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:13.402385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f092c-0f7e-4974-a147-ac20818d51e9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:13.411542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:13.412513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.412885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.413255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.414453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:13.414888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:13.417460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:13.426176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 587/1179] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:13.431613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:13.441610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9a133-8403-4941-bd81-89883389748a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:13.447793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:13.448617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.448928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.449200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] PATH_INFO: `/v3/users/0d636d656e9547aba4505bf371e3cc57` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.463879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d636d656e9547aba4505bf371e3cc57)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:13.466069 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:13.467652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 593/1180] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:46:13 2022] GET /identity/v3/users/0d636d656e9547aba4505bf371e3cc57 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:46:13.473133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:13.483164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4acafa-2fe8-410c-a80c-57291d8d81c9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:13.489554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:13.490168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.490439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.490703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.499058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:13.500798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:13.510152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 588/1181] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:46:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:46:13.515814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:13.525936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c00d1-5721-4a81-b3b9-02b06d6b20b1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:13.531988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b39af-9062-4077-a22e-e0287d831739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:13.532858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b39af-9062-4077-a22e-e0287d831739 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.533124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b39af-9062-4077-a22e-e0287d831739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.533398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b39af-9062-4077-a22e-e0287d831739 admin admin] PATH_INFO: `/v3/projects/a35c35fc347e472ca4983c4ed3954aff` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.534620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b39af-9062-4077-a22e-e0287d831739 admin admin] RBAC: Authorizing `identity:get_project(project_id=a35c35fc347e472ca4983c4ed3954aff)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:13.536630 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b39af-9062-4077-a22e-e0287d831739 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:13.538274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 594/1182] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:46:13 2022] GET /identity/v3/projects/a35c35fc347e472ca4983c4ed3954aff => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:13.543955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:13.552553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4a71-9051-4721-afc8-6aea06086a45 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:13.559238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:13.559847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:13.560122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:13.560386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:13.561259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=a35c35fc347e472ca4983c4ed3954aff, user.id=0d636d656e9547aba4505bf371e3cc57) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:13.561562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:13.563365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf806d-baa7-449f-9530-674a68878f54 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:13.568842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 589/1183] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:46:13 2022] GET /identity/v3/role_assignments?user.id=0d636d656e9547aba4505bf371e3cc57&scope.project.id=a35c35fc347e472ca4983c4ed3954aff&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:15.723801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1c0d-2865-4454-8a80-33095ade29b1 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.724432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1c0d-2865-4454-8a80-33095ade29b1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.724432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1c0d-2865-4454-8a80-33095ade29b1 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.727074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 595/1184] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:15.734326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.734811 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.734915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.753763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:15.755008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:15.764611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 590/1185] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:15.788501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1c0d-2865-4454-8a80-33095ade29b1 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:15.809764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1c0d-2865-4454-8a80-33095ade29b1 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:15.815052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:15.815824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.816111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.816379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.827151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:46:15.833785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:46:15.834923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 596/1186] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:46:15.841253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:15.855315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fccdef-6457-4b0e-bfad-5a5e3e994f8f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:15.864752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:15.865691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.866034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.866361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.867514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:15.867914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:15.870429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:15.879479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 591/1187] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:15.888182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:15.901829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf1a9b-3fdd-43a6-a793-1371f0cdf7ec admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:15.907534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:15.908348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.908617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.908919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] PATH_INFO: `/v3/users/0d636d656e9547aba4505bf371e3cc57` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.910211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d636d656e9547aba4505bf371e3cc57)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:15.912310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:15.913883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 597/1188] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:46:15 2022] GET /identity/v3/users/0d636d656e9547aba4505bf371e3cc57 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:15.919235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:15.928655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e79-6355-4657-af66-738c9202a5c4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:15.934361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b217ee-e444-4b22-a024-4691a7a65a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:15.935253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b217ee-e444-4b22-a024-4691a7a65a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.935520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b217ee-e444-4b22-a024-4691a7a65a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.935783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b217ee-e444-4b22-a024-4691a7a65a83 admin admin] PATH_INFO: `/v3/projects/a35c35fc347e472ca4983c4ed3954aff` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.937089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b217ee-e444-4b22-a024-4691a7a65a83 admin admin] RBAC: Authorizing `identity:get_project(project_id=a35c35fc347e472ca4983c4ed3954aff)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:15.939066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b217ee-e444-4b22-a024-4691a7a65a83 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:15.940633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 592/1189] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:46:15 2022] GET /identity/v3/projects/a35c35fc347e472ca4983c4ed3954aff => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:46:15.946093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:15.956392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0d289-7767-4195-800e-24ec9fc190d5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:15.962539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049370d5-2a82-44ff-ba72-329eaa2c9b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:15.963401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049370d5-2a82-44ff-ba72-329eaa2c9b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:15.963676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049370d5-2a82-44ff-ba72-329eaa2c9b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:15.963944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049370d5-2a82-44ff-ba72-329eaa2c9b01 admin admin] PATH_INFO: `/v3/projects/a35c35fc347e472ca4983c4ed3954aff/users/0d636d656e9547aba4505bf371e3cc57/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:15.966369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049370d5-2a82-44ff-ba72-329eaa2c9b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35c35fc347e472ca4983c4ed3954aff, user_id=0d636d656e9547aba4505bf371e3cc57, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:15.969027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049370d5-2a82-44ff-ba72-329eaa2c9b01 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:15.985789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 598/1190] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:46:15 2022] PUT /identity/v3/projects/a35c35fc347e472ca4983c4ed3954aff/users/0d636d656e9547aba4505bf371e3cc57/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:46:18.105027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c00c2-8706-4126-8366-4c62b92c4565 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.105491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c00c2-8706-4126-8366-4c62b92c4565 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.105588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c00c2-8706-4126-8366-4c62b92c4565 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.107354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 593/1191] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:46:18.113933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.114645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.114739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.137351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:46:18.138546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:46:18.200280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 599/1192] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:46:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:46:18.229572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c00c2-8706-4126-8366-4c62b92c4565 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:18.244763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c00c2-8706-4126-8366-4c62b92c4565 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:18.250749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:18.251519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.251793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.252061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.263964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:46:18.270551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:46:18.271687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 594/1193] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:46:18.278163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:18.293163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22683d0-83e8-48fc-a554-0acf0f084634 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:18.302699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:18.303644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.304010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.304376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.305607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:18.306014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:18.308528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:18.317510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 600/1194] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:18.325629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:18.341192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8f3d5-8575-4b6b-b0ce-a4b3e420e05d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:18.346854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:18.347683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.347976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.348239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] PATH_INFO: `/v3/users/0d636d656e9547aba4505bf371e3cc57` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.349563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d636d656e9547aba4505bf371e3cc57)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:18.351683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:18.353273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 595/1195] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 3 02:46:18 2022] GET /identity/v3/users/0d636d656e9547aba4505bf371e3cc57 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:18.358690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:18.368888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d47d-db35-4569-aecd-733e8d077a90 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:18.374477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:18.375087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.375322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.375611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.383772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:18.385536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:18.397076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 601/1196] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:46:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:46:18.405804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:18.420861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30d6b1-828e-4198-acf0-6220a7354ea0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:18.427408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85209b-597a-466d-ac3c-81fa300efddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:18.428230 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85209b-597a-466d-ac3c-81fa300efddb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.428499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85209b-597a-466d-ac3c-81fa300efddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.428746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85209b-597a-466d-ac3c-81fa300efddb admin admin] PATH_INFO: `/v3/projects/a35c35fc347e472ca4983c4ed3954aff` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.430177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85209b-597a-466d-ac3c-81fa300efddb admin admin] RBAC: Authorizing `identity:get_project(project_id=a35c35fc347e472ca4983c4ed3954aff)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:18.432189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85209b-597a-466d-ac3c-81fa300efddb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:18.433863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 596/1197] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:46:18 2022] GET /identity/v3/projects/a35c35fc347e472ca4983c4ed3954aff => generated 361 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:46:18.439600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:46:18.449070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3ca7-3f78-43ae-980e-23b338054439 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:46:18.455073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:46:18.455681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:46:18.455953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:46:18.456221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:46:18.457074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=a35c35fc347e472ca4983c4ed3954aff, user.id=0d636d656e9547aba4505bf371e3cc57) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:46:18.457378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:46:18.459186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1074-de85-44fc-acaf-5e653021bd4a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:46:18.465356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 602/1198] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:46:18 2022] GET /identity/v3/role_assignments?user.id=0d636d656e9547aba4505bf371e3cc57&scope.project.id=a35c35fc347e472ca4983c4ed3954aff&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:18.091345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a583d-b26d-4eda-9317-1ecfbda6e7a2 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:18.091921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a583d-b26d-4eda-9317-1ecfbda6e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:18.091921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a583d-b26d-4eda-9317-1ecfbda6e7a2 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:18.094007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 597/1199] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:18.099708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:18.100147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:18.100236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:18.122928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:18.124200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:18.133266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 603/1200] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:18.160998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a583d-b26d-4eda-9317-1ecfbda6e7a2 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:18.182793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a583d-b26d-4eda-9317-1ecfbda6e7a2 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:18.190071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:18.191077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:18.191638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:18.192124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:18.204252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:18.206455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:18.231143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:18.232561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 598/1201] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:18.243801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:18.249541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034baec-7e36-4a53-b9b8-068a0145c128 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:18.254737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:18.255407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:18.255703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:18.256048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:18.256871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:18.257200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:18.259040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c758d-6d22-4afa-9f8a-8f37843c2989 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:18.272248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 604/1202] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:18.278601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:18.294841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fe5a9-2017-4c6a-a630-891b148276d3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:18.301805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ff47-aae9-418f-81d8-3a17670502f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:18.301805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ff47-aae9-418f-81d8-3a17670502f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:18.301805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ff47-aae9-418f-81d8-3a17670502f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:18.301805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ff47-aae9-418f-81d8-3a17670502f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:18.302317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27ff47-aae9-418f-81d8-3a17670502f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:18.304532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27ff47-aae9-418f-81d8-3a17670502f5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:18.328463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 599/1203] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 3 02:47:18 2022] POST /identity/v3/users => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:47:20.876355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe81521-7035-4423-b444-6f6c2e9ef312 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:20.876930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe81521-7035-4423-b444-6f6c2e9ef312 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:20.877014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe81521-7035-4423-b444-6f6c2e9ef312 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:20.878962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 605/1204] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:20.887228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:20.887704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:20.887809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:20.907917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:20.909438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:20.918939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 600/1205] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:20.944646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe81521-7035-4423-b444-6f6c2e9ef312 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:20.958581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe81521-7035-4423-b444-6f6c2e9ef312 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:20.963196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:20.963985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:20.964263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:20.964562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:20.977404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:47:20.985128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:47:20.986756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 606/1206] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:47:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:20.992700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.002434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b2ac-5a73-45e4-9c5d-135f3fbd1f94 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.008052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.008751 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.009035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.009299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.010060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:21.010360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.011946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.024069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 601/1207] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:47:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:21.032272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.045235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca11bd-e538-4239-ad5f-e30c0fc07f01 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.050330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.051175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.051538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.051868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.063325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.065461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.087818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:21.089351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 607/1208] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:21.095292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.109487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3dde-2b8d-4d0c-a151-e7ecb89bffdd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.114734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.115392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.115666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.115930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.116710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:21.117130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.118915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.131461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 602/1209] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:21.137590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.148190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408df81-19fe-4ee2-b435-bbc2948089be admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.153266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.154058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.154333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.154602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.165541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.168024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.184837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 03 02:47:21.190170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 608/1210] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:21.193472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.203511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8436c-b833-450d-858f-5a1fb863d110 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.208885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.209636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.209917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.210202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.211061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:21.211425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.214138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.235967 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 603/1211] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:21.243499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.254434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec058-70f5-42f7-84cc-a79bd4c9ff51 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.260188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.260861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.261170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.261403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.269665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.271525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.282579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 609/1212] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:47:21.288767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.299030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe795d62-67a0-44eb-987b-d4b06e5bb9be admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.304818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.305719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.305938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.307331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.316790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.318663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.338452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:21.340703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 604/1213] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:21.346322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.358448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcac83-81a7-4293-8e3d-b031c454a3c2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.364700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.365473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.365784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.366055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.366950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:21.367201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.369194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.382830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 610/1214] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:21.388881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.399915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb99fb-0997-4d37-a8c1-2d87cec0c22d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.406042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.406846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.407126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.407398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.416415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.418992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.434414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:47:21.440653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 605/1215] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:21.441949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.452524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae1cdf-f4ae-4eb2-8f71-c419b00457e3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.457490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.458108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.458435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.458691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.459577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:21.459905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.461991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd410-03e0-405b-bf79-d7415387e8f8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.474963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 611/1216] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:21.480975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:21.492107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5b48-210b-4f6b-bf75-a18c8a0183c2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:21.497203 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:21.498511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:21.498511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:21.498704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:21.499375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=d598cc17e70b46058bd824c031a0186c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:21.499726 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:21.501591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607167-5e6c-4c64-9c70-70b7ba565d1e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:21.507336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 606/1217] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:47:21 2022] GET /identity/v3/role_assignments?user.id=d598cc17e70b46058bd824c031a0186c&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:23.805073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215714c-8d4c-47b0-ad0f-d4fab10bd803 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:23.805073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215714c-8d4c-47b0-ad0f-d4fab10bd803 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:23.806179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215714c-8d4c-47b0-ad0f-d4fab10bd803 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:23.808298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 612/1218] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:23.814128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:23.814583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:23.814678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:23.832789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:23.834006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:23.843025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 607/1219] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:23.868823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215714c-8d4c-47b0-ad0f-d4fab10bd803 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:23.882371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215714c-8d4c-47b0-ad0f-d4fab10bd803 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:23.887758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:23.888624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:23.888953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:23.889237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:23.900240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:47:23.907661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:47:23.913868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 613/1220] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:23.915240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:23.925087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8b99b-45c5-4ffe-b556-eef0f518e60d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:23.931324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:23.932005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:23.932288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:23.932554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:23.933424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:23.933737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:23.935442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:23.952756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 608/1221] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:23.954847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:23.966048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892aca1-0f5d-452c-8cb5-6acbfb61c613 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:23.971330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:23.972109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:23.972387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:23.972654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:23.983894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:23.986217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.006422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:24.012311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 614/1222] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:24.013736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.024118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ad282-4759-45d1-9a0a-1674479d9517 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.029110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.029770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.030040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.030302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.031085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:24.031462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.033207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.046139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 609/1223] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:24.051949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.062657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47086d6-ae4f-491c-aead-3a08515eb731 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.069074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.069074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.069074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.069074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.077194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.080355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.094736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 03 02:47:24.096094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 615/1224] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:24.101961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.113066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09de9-2575-4f0f-91c1-7ea96fb3c69c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.118750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.119502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.119814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.120083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.121036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:24.121339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.123380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.145744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 610/1225] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:24.153356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.163590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ce19d-5b5d-4351-8ba2-d557f2188f2e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.168964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.169838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.170082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.170407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.181351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.183221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.200543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:24.202138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 616/1226] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:24.208202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.219001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76b352-a4d1-4b27-9cb4-59727973a616 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.224202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.225004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.225281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.225555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.226299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:24.226599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.228286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.240674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 611/1227] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:24.246628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.257244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832604b3-a34a-475e-ab98-115628e690f8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.262750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.263616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.263901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.264187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.272357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.274447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.288871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:47:24.290153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 617/1228] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:24.296314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.307017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95088-658d-46a4-b88f-7eaaa6ef7137 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.312476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.313249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.313437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.313773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.314592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:24.314922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.317013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75741c5f-db44-48e8-980f-8e5f9e075609 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.330420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 612/1229] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:24.336609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:24.347719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaccb9-f081-4a39-9f56-dca6b2087f9d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:24.352867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02971d-93c9-4575-bd78-39e656c03639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:24.353843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02971d-93c9-4575-bd78-39e656c03639 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:24.354110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02971d-93c9-4575-bd78-39e656c03639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:24.354425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02971d-93c9-4575-bd78-39e656c03639 admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/d598cc17e70b46058bd824c031a0186c/roles/d8724d77b92646cca8fbcdcd62565936` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:24.370833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02971d-93c9-4575-bd78-39e656c03639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=d598cc17e70b46058bd824c031a0186c, role_id=d8724d77b92646cca8fbcdcd62565936)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:24.373811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02971d-93c9-4575-bd78-39e656c03639 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:24.387642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 618/1230] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:47:24 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/d598cc17e70b46058bd824c031a0186c/roles/d8724d77b92646cca8fbcdcd62565936 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:47:26.806945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950eca-2dd7-44a1-adcf-661b341ae266 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:26.807518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950eca-2dd7-44a1-adcf-661b341ae266 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:26.807518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950eca-2dd7-44a1-adcf-661b341ae266 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:26.809655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 613/1231] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:47:26.816146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:26.816615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:26.816866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:26.838240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:26.839696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:26.901105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 619/1232] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:26.925094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950eca-2dd7-44a1-adcf-661b341ae266 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:26.939972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950eca-2dd7-44a1-adcf-661b341ae266 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:26.945607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:26.946478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:26.946758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:26.947022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:26.958884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:47:26.965867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 03 02:47:26.967088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 614/1233] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 3 02:47:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:26.973343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:26.982819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c991c-3a35-4fac-9dc7-228f1c753afd None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:26.988641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:26.989445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:26.989764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:26.990528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:26.991085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:26.991476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:26.993411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.003947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 620/1234] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 3 02:47:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:27.011138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.024227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b313a1-200a-408f-8a6e-436ee7bd9f9a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.030204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.031107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.031408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.031661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.043340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.045239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.066969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:27.068465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 615/1235] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:27.077104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.091146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cef82-852d-4f3d-bacb-19d9a739c315 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.096850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.097522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.097820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.098244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.098990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:27.099278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.101140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.114779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 621/1236] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:27.120616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.130429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ebf0f-1984-45d5-98ff-2a806c15bbaf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.135635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.136427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.136705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.137004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.146243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.148264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.163074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 03 02:47:27.164249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 616/1237] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:27.170471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.182477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6722202-51f2-4604-9c47-af8bc6cf3987 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.188424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.189216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.189500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.189792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.190730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:27.191130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.193414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.212703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 622/1238] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:27.218497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.229180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4075-eea4-41db-9192-5b12cbc9c90a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.234791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.235423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.235694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.235982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.244108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.245908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.255089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 617/1239] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:47:27.260912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.270954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f0665-bd45-4715-8464-66d47263dd6a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.275572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.276480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.276860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.277191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.287648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.289797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.308896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:27.310254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 623/1240] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:27.318325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.327797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244fe04-39eb-44d3-bd85-1cadd29e32cb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.332474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.333174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.333449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.333717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.334450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:27.334747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.336335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.347769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 618/1241] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:27.353448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.363967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d57af-674d-4c56-9be3-9feb40b0c72e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.368971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.369843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.370158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.370460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.378655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.381020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.394710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:47:27.396023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 624/1242] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:27.402368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.413282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de5a8-11fb-4534-aa02-87e6f70afe16 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.419346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.419996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.420274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.420548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.421378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:27.421681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.423534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b982c-d378-4f03-b6a3-473f89b8a753 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.442618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 619/1243] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:27.443941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:27.455156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fa44-9846-46d7-a876-44e6e916c1aa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:27.460354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:27.461056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:27.461343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:27.461640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:27.462628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] RBAC: Adding query filter params (role.id=d8724d77b92646cca8fbcdcd62565936, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=d598cc17e70b46058bd824c031a0186c) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:27.462940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:27.465078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9ef2-758d-4f90-b3f0-03962b663f9a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:27.471269 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 625/1244] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:47:27 2022] GET /identity/v3/role_assignments?user.id=d598cc17e70b46058bd824c031a0186c&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=d8724d77b92646cca8fbcdcd62565936 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:29.700126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb9aa-e919-4806-9c95-f8146b7c3221 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.700668 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb9aa-e919-4806-9c95-f8146b7c3221 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.700801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb9aa-e919-4806-9c95-f8146b7c3221 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.702741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 620/1245] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:29.708162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.708585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.708693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.727145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:29.728328 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:29.736427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 626/1246] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:29.759983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eb9aa-e919-4806-9c95-f8146b7c3221 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:29.772744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eb9aa-e919-4806-9c95-f8146b7c3221 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:29.777577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:29.778375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.778649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.778916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.789470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:47:29.796237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:47:29.797456 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 621/1247] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:47:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:29.803780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:29.813171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196aac-24c0-497c-9764-2310d3febf33 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:29.817988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:29.818650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.818927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.819193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.819946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:29.820247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:29.821931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:29.830722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 627/1248] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:29.836480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:29.846738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134355c0-8e27-4801-954b-0b5c17f50343 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:29.851358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:29.852169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.852430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.852696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.863783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:29.865765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:29.883114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:29.889368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 622/1249] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:29.890482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:29.901037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb7776-6d50-4a0c-898e-4e6e9bc4a321 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:29.906114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:29.906762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.907055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.907400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.908122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:29.908420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:29.910048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:29.923755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 628/1250] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:29.930439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:29.942745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbb96-e528-400d-800f-0582b7dc3cf4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:29.948803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:29.949611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:29.949883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:29.950196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:29.958862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:29.960950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:29.977021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 03 02:47:29.978366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 623/1251] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:29.985346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:29.995527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6776d2-2396-4ef2-8921-8d14b04cc101 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.000832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.001576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.001850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.002116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.003080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:30.003381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.005255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.029660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 629/1252] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 3 02:47:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:30.030948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:30.041998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a856-ab3e-46f6-b58b-1aa933a99463 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.047694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.048419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.048852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.049126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.057983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.059755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.069162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 624/1253] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:47:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:47:30.076053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:30.088779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9768100-d7da-45c8-be9e-663768d79839 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.095860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.097335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.097829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.098389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.116704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.119039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.135768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:30.136989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 630/1254] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:30.143431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:30.153337 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ff898-0a85-400b-a610-bc853c4db678 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.159051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.159716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.160001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.160286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.161053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:30.161359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.162963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.175876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 625/1255] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:30.181838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:30.191895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c59406-a4ec-4f82-bfef-cf6b3e72f208 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.196615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.197432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.197712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.197989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.205033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.206899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.219998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:47:30.221201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 631/1256] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:47:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:30.227975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:30.238388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c38a-0074-4a37-b658-4b6408b7850c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.244170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.244860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.245133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.245402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.246202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:30.246537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.248405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99b287-41c4-41f4-bf1f-5f1ea5c9b37c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.260777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 626/1257] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:30.266986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:30.277557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f0400-1e48-4e53-9061-40bb589cb3b3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:30.282308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:30.282894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:30.283221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:30.283491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:30.284360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=d598cc17e70b46058bd824c031a0186c) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:30.284678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:30.286785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477230a7-ff0a-4891-b387-5ad992714f5f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:30.292354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 632/1258] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:47:30 2022] GET /identity/v3/role_assignments?user.id=d598cc17e70b46058bd824c031a0186c&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:32.576273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eee28-138b-4546-a70f-07237428ca79 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.576886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eee28-138b-4546-a70f-07237428ca79 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.576886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eee28-138b-4546-a70f-07237428ca79 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.578604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 627/1259] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:32.585064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.585644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.585644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.605432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:32.606864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:32.616707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 633/1260] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:32.640132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eee28-138b-4546-a70f-07237428ca79 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.654200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eee28-138b-4546-a70f-07237428ca79 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.659349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.660406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.660710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.661047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.673371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:47:32.680065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:47:32.681386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 628/1261] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:32.687532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.697169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d7cb3-1d8b-471b-8f7b-728e29a6aaab None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.702346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.703247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.703640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.704006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.705125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:32.705498 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.707481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:32.717771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 634/1262] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:32.723786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.735048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeade6-7223-4ebd-a89a-62883cd031d0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.740101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.741039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.741313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.741579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.754444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.756617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:32.778114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:32.780018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 629/1263] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:32.786985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.797264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6617e9-021b-48fc-990f-41f3fffc9659 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.801815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.802518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.802733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.803003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.803723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:32.804022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.805811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:32.818266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 635/1264] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:32.825446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.837155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8c44-ab64-460c-8874-59eda0a98c9e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.842603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.843402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.843675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.843940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.851915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.854061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:32.868534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 03 02:47:32.869737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 630/1265] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:32.876399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.886758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26b3fe-34f6-4fb9-88e0-56976b262f94 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.892490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.893183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.893461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.893727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.894609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:32.894909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.896748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:32.914195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 636/1266] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:32.920012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.930162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e8a33-e482-4e75-9b3f-a925095814b9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.934840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.935604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.935876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.936141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.946496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.948351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:32.965617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:32.971358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 631/1267] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:32.972603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:32.984586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84869-7768-406d-851f-80b5fd722ca2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:32.990790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:32.991450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:32.991730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:32.992009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:32.992812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:32.993118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:32.994775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:33.009562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 637/1268] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:33.016315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:33.027717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9ce4-1709-4562-a176-2801a526301c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:33.033301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:33.034084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:33.034363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:33.034635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:33.042365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:33.044500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:33.059820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:47:33.061217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 632/1269] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:33.067474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:33.078856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f62d03-c6a2-4fa6-ba18-20b13151e749 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:33.084367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:33.084901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:33.085181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:33.085449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:33.086249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:33.086587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:33.088504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b077ab-7d96-4de0-a01a-d16a755034a9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:33.101322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 638/1270] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:33.107767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:33.119500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9160a65-17b6-4b63-a761-9cc1211863fd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:33.124696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae49290-6988-4cab-be43-90098054763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:33.125596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae49290-6988-4cab-be43-90098054763b admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:33.125869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae49290-6988-4cab-be43-90098054763b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:33.126135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae49290-6988-4cab-be43-90098054763b admin admin] PATH_INFO: `/v3/projects/3e9c65257f44407bad0733973d36ce69/users/d598cc17e70b46058bd824c031a0186c/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:33.128075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae49290-6988-4cab-be43-90098054763b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65257f44407bad0733973d36ce69, user_id=d598cc17e70b46058bd824c031a0186c, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:33.130733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae49290-6988-4cab-be43-90098054763b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:33.146791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 633/1271] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 3 02:47:33 2022] PUT /identity/v3/projects/3e9c65257f44407bad0733973d36ce69/users/d598cc17e70b46058bd824c031a0186c/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:47:35.632975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda19b4-da38-4eb1-9227-d62af09b2b59 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.633578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda19b4-da38-4eb1-9227-d62af09b2b59 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.633578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda19b4-da38-4eb1-9227-d62af09b2b59 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.635353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 639/1272] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:35.640978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.641479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.641572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.660362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:35.661623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:35.720793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 634/1273] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:35.745079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda19b4-da38-4eb1-9227-d62af09b2b59 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:35.757351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda19b4-da38-4eb1-9227-d62af09b2b59 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:35.761855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:35.762631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.762906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.763171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.773597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 03 02:47:35.780363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 03 02:47:35.781616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 640/1274] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 3 02:47:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:35.787608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:35.796579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a06a08-1a2f-420c-9cb3-8f10f1a7e3cc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:35.801186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:35.801833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.802105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.802369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.803125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:35.803420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:35.805064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:35.813338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 635/1275] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 3 02:47:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:35.819384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:35.829671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075a8f-6342-47f5-9676-2b705b90db2b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:35.834179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:35.834981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.835261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.835495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.846686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:35.848546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:35.867506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:35.869044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 641/1276] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 03 02:47:35.876375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:35.887189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcacd-4715-4387-8bea-17b53adee8c4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:35.892298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:35.892988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.893260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.893522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.894386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:35.894798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:35.896541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:35.908649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 636/1277] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:35.914678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:35.924571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce4eb-2ef3-4083-aaed-2c2817bf9a8e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:35.929181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:35.932077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.934390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.934658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.942164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:35.944191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:35.959010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 03 02:47:35.960163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 642/1278] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:35.966408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:35.977015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf1371-ceb1-4704-a927-5975f50b6ff2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:35.984130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:35.986528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:35.986873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:35.987181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:35.988343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:35.988673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:35.993911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.015515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 637/1279] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 3 02:47:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:36.021889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:36.033346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3881ea-bb11-4bf0-bb25-83c1f87a1a78 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:36.039201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:36.039912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:36.040198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:36.040494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:36.048564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:36.050691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.060658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 643/1280] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 3 02:47:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:47:36.066718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:36.076541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e6d0-07e6-47a0-b6d1-ce02a1638672 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:36.081762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:36.082597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:36.082875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:36.083129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:36.093960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:36.095789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.114545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 03 02:47:36.115811 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 638/1281] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 3 02:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:36.121888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:36.131636 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143223ba-bafd-46b1-b1eb-7f7a66f8ab50 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:36.137018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:36.137769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:36.137986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:36.138257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:36.139008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:36.139311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:36.140997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.154115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 644/1282] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 3 02:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:36.160506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:36.171220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a71d3-2cbd-419d-90d1-932ea3c4f83e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:36.176374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:36.177228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:36.177510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:36.177811 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:36.186436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:36.188433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.203381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING keystone.server.flask.application [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 03 02:47:36.204672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 639/1283] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 3 02:47:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:36.210880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:36.221363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566aa4-e7b2-450d-b366-e59163471773 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:36.226311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:36.226971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:36.227249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:36.227518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:36.228316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:36.228622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:36.230524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415cef-f73e-4f4d-a116-a00aa3045ebe admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.245234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 645/1284] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 3 02:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:36.251826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:36.263280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce18a3-2f64-41fd-92c8-73d560c2d4e9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:36.269385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:36.270066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:36.270337 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:36.270600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:36.271450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] RBAC: Adding query filter params (role.id=bc3228c6420840ccac55bec33bfa0fb1, scope.project.id=3e9c65257f44407bad0733973d36ce69, user.id=d598cc17e70b46058bd824c031a0186c) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:36.271759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:36.273819 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13eef6-78ab-4d89-936f-8a06e9074fc7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:36.281011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 640/1285] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 3 02:47:36 2022] GET /identity/v3/role_assignments?user.id=d598cc17e70b46058bd824c031a0186c&scope.project.id=3e9c65257f44407bad0733973d36ce69&role.id=bc3228c6420840ccac55bec33bfa0fb1 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:38.529038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00cdd-dc50-4165-9b99-5ce885123e4b None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:38.529669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00cdd-dc50-4165-9b99-5ce885123e4b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:38.529756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00cdd-dc50-4165-9b99-5ce885123e4b None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:38.531974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 646/1286] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:38.538731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:38.539206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:38.539519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:38.561612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:38.563016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:38.572479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 641/1287] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:38.601072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00cdd-dc50-4165-9b99-5ce885123e4b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:38.614339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00cdd-dc50-4165-9b99-5ce885123e4b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:38.619810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:38.620596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:38.620905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:38.621174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:38.621840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:38.623455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:38.634971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 03 02:47:38.636101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 647/1288] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:47:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:38.642626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:38.657130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e05e1f-e1cd-4b5a-b9c5-fe17fbbf3176 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:38.665591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:38.666244 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:38.666523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:38.666793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:38.667529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:38.667832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:38.669484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef196-f964-4f40-b0c7-dadc5edf4da0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:38.674721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 642/1289] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 3 02:47:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:38.680128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:38.690212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81345d1c-0913-4466-aacb-c13b97354725 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:38.696287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:38.696946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:38.697224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:38.697493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] PATH_INFO: `/v3/services` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:38.698197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:38.698503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:38.700062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72255e-67ab-4d9b-a9c0-08ff8ac38383 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:38.704544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 648/1290] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 3 02:47:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:40.931202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91453-f8bd-43cd-b917-ec3314f9451a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:40.932093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91453-f8bd-43cd-b917-ec3314f9451a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:40.932093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91453-f8bd-43cd-b917-ec3314f9451a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:40.934962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 643/1291] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:40.941247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639d52d-32d9-4043-94f9-9f239e7863a5 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:40.941958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639d52d-32d9-4043-94f9-9f239e7863a5 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:40.942133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639d52d-32d9-4043-94f9-9f239e7863a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:40.963555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0639d52d-32d9-4043-94f9-9f239e7863a5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:40.964747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0639d52d-32d9-4043-94f9-9f239e7863a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:40.973385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 649/1292] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:40.996225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de91453-f8bd-43cd-b917-ec3314f9451a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:41.010424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de91453-f8bd-43cd-b917-ec3314f9451a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:41.016051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce760c5-f7ac-4a02-be51-4e6289948742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:41.016687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce760c5-f7ac-4a02-be51-4e6289948742 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:41.016997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce760c5-f7ac-4a02-be51-4e6289948742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:41.017267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce760c5-f7ac-4a02-be51-4e6289948742 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:41.018011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce760c5-f7ac-4a02-be51-4e6289948742 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:41.019590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce760c5-f7ac-4a02-be51-4e6289948742 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:41.036202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 644/1293] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 3 02:47:40 2022] POST /identity/v3/services => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:47:43.253174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397d48-9c1a-4104-be74-b1c7942041a4 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:43.254066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397d48-9c1a-4104-be74-b1c7942041a4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:43.254066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397d48-9c1a-4104-be74-b1c7942041a4 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:43.256859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 650/1294] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:43.265525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:43.265957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:43.266097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:43.293925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:43.295118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:43.314180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 645/1295] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:43.338194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee397d48-9c1a-4104-be74-b1c7942041a4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:43.358343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee397d48-9c1a-4104-be74-b1c7942041a4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:43.364661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:43.365475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:43.365757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:43.366023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:43.366684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:43.368298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:43.379908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 03 02:47:43.381062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 651/1296] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:47:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:43.389606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:43.403931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f7903-f737-4e0e-9753-df69e696ea3b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:43.413237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:43.414204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:43.414479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:43.414749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:43.415471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:43.415772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:43.417402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:43.423013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 646/1297] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 3 02:47:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:43.429227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:43.444476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6704b7-52f3-42f5-ab31-a72235e9d031 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:43.450804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:43.451416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:43.451689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:43.451962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:43.452754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] RBAC: Adding query filter params (interface=public, service_id=d150e783b395449390b81e50c3a87325, region_id=RegionOne) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:43.453085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:43.454635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87727d-beeb-462c-982f-c70a531caba5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:43.459981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 652/1298] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 3 02:47:43 2022] GET /identity/v3/endpoints?service_id=d150e783b395449390b81e50c3a87325&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:47:43.465322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:43.475127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9dc82-46cf-454b-97fc-8add9d906e43 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:43.481397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553cfba-cda5-4146-adbf-83d8577abd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:43.482006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553cfba-cda5-4146-adbf-83d8577abd87 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:43.482289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553cfba-cda5-4146-adbf-83d8577abd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:43.482559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553cfba-cda5-4146-adbf-83d8577abd87 admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:43.484851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553cfba-cda5-4146-adbf-83d8577abd87 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:43.485147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553cfba-cda5-4146-adbf-83d8577abd87 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:43.492096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 647/1299] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:47:43 2022] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:47:45.667268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339eeb-51d4-4ed6-87f4-2136331d2fff None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:45.667889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339eeb-51d4-4ed6-87f4-2136331d2fff None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:45.667889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339eeb-51d4-4ed6-87f4-2136331d2fff None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:45.669643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 653/1300] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:47:45.675996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:45.676465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:45.676563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:45.701944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:47:45.703137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:47:45.712744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 648/1301] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:47:45.736370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339eeb-51d4-4ed6-87f4-2136331d2fff None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:45.750627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339eeb-51d4-4ed6-87f4-2136331d2fff None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:45.756096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:45.756891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:45.757169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:45.757483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:45.758120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:45.759731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:45.771211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING keystone.server.flask.application [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 03 02:47:45.772320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 654/1302] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 3 02:47:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 03 02:47:45.778297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:45.787402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a34aa0-7bbf-4ec9-8346-28a86009f48e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:45.793913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:45.794561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:45.794838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:45.795108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] PATH_INFO: `/v3/services` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:45.795828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:47:45.796137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:45.797776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa55e8-9773-4a7f-8a81-273bb8260f2b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:45.803162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 649/1303] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 3 02:47:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:47:45.808649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:47:45.818793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8f6c-f449-4c62-8c45-588f8dcd9324 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:47:45.824340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317cbdd-70fa-4679-94b4-df5e1fbfe07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:47:45.824976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317cbdd-70fa-4679-94b4-df5e1fbfe07a admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:47:45.825256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317cbdd-70fa-4679-94b4-df5e1fbfe07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:47:45.825525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317cbdd-70fa-4679-94b4-df5e1fbfe07a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:47:45.826264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317cbdd-70fa-4679-94b4-df5e1fbfe07a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:47:45.827792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317cbdd-70fa-4679-94b4-df5e1fbfe07a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:47:45.850973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 655/1304] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 3 02:47:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:48:48.629809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303de42-3aed-4c33-a0e8-46921c4c4dc2 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:48.630636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303de42-3aed-4c33-a0e8-46921c4c4dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:48.631055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303de42-3aed-4c33-a0e8-46921c4c4dc2 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:48.637252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 650/1305] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:48:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:48:48.638568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc8f9-426d-4328-adaf-f11f4aac6158 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:48.638999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc8f9-426d-4328-adaf-f11f4aac6158 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:48.639096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc8f9-426d-4328-adaf-f11f4aac6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:48.750109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7f6cc8f9-426d-4328-adaf-f11f4aac6158 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:48:48.751312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7f6cc8f9-426d-4328-adaf-f11f4aac6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:49.025126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 656/1306] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:48:49.051373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303de42-3aed-4c33-a0e8-46921c4c4dc2 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:48:49.053414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6303de42-3aed-4c33-a0e8-46921c4c4dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:49.296539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303de42-3aed-4c33-a0e8-46921c4c4dc2 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:48:49.501073 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133df77-b79b-424e-8b04-580eb317688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:48:49.501966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133df77-b79b-424e-8b04-580eb317688e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:49.502392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133df77-b79b-424e-8b04-580eb317688e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:49.502808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133df77-b79b-424e-8b04-580eb317688e admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:49.503711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133df77-b79b-424e-8b04-580eb317688e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:48:49.505764 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133df77-b79b-424e-8b04-580eb317688e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:48:49.573683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 651/1307] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:48:49 2022] GET /identity/v3/projects => generated 2553 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:48:51.847947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67c40-d516-4124-a9e4-50cebb3116d3 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:51.848501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67c40-d516-4124-a9e4-50cebb3116d3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:51.848501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67c40-d516-4124-a9e4-50cebb3116d3 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:51.850314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 657/1308] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:48:51.856122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19e29-cbac-4513-8e9b-49c672b759ef None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:51.856585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19e29-cbac-4513-8e9b-49c672b759ef None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:51.856685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19e29-cbac-4513-8e9b-49c672b759ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:51.934197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-aff19e29-cbac-4513-8e9b-49c672b759ef None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:48:51.935328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-aff19e29-cbac-4513-8e9b-49c672b759ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:52.032406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 652/1309] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:48:52.055757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67c40-d516-4124-a9e4-50cebb3116d3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:48:52.057311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c4f67c40-d516-4124-a9e4-50cebb3116d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:52.191871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67c40-d516-4124-a9e4-50cebb3116d3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:48:52.287402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033699-b72d-417d-91ae-48afd327f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:48:52.288076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033699-b72d-417d-91ae-48afd327f76e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:52.288343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033699-b72d-417d-91ae-48afd327f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:52.288614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033699-b72d-417d-91ae-48afd327f76e admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:52.289443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd033699-b72d-417d-91ae-48afd327f76e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:48:52.291313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd033699-b72d-417d-91ae-48afd327f76e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:48:52.309622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 658/1310] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:48:52 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:48:54.535220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d027-367a-448a-b623-b9cf33d6712c None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:54.535750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d027-367a-448a-b623-b9cf33d6712c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:54.535750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d027-367a-448a-b623-b9cf33d6712c None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:54.537475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 653/1311] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:48:54.542971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab2658-7887-4940-b862-52fa62fa7eb5 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:54.543396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab2658-7887-4940-b862-52fa62fa7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:54.543553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab2658-7887-4940-b862-52fa62fa7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:54.610410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d6ab2658-7887-4940-b862-52fa62fa7eb5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:48:54.611677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d6ab2658-7887-4940-b862-52fa62fa7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:54.703836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 659/1312] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:48:54.755654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd9eaa-0bfb-40c8-b0e6-1ca43a15d399 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:54.755890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd9eaa-0bfb-40c8-b0e6-1ca43a15d399 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:54.756195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd9eaa-0bfb-40c8-b0e6-1ca43a15d399 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:54.758038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 654/1313] 10.222.0.31 () {54 vars in 964 bytes} [Thu Feb 3 02:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:48:54.765114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43352-e656-40c4-b0a3-695427d86f5b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:54.765474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43352-e656-40c4-b0a3-695427d86f5b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:54.765851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43352-e656-40c4-b0a3-695427d86f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:54.846863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-32e43352-e656-40c4-b0a3-695427d86f5b None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:48:54.847927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-32e43352-e656-40c4-b0a3-695427d86f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:54.921639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 660/1314] 10.222.0.31 () {58 vars in 1061 bytes} [Thu Feb 3 02:48:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:48:54.934017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd9eaa-0bfb-40c8-b0e6-1ca43a15d399 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:48:54.935514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-54bd9eaa-0bfb-40c8-b0e6-1ca43a15d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:55.046800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd9eaa-0bfb-40c8-b0e6-1ca43a15d399 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:48:55.120152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:48:55.120760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:55.121042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:55.121306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:55.122943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:55.235675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:48:55.237405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59e1bc-1cc1-4c11-bda0-5db6dfb1c4a7 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:48:55.255006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 655/1315] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:48:57.697685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab46cbc-282a-40cd-aeef-cf70b0ef4cb7 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:57.698573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab46cbc-282a-40cd-aeef-cf70b0ef4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:57.698573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab46cbc-282a-40cd-aeef-cf70b0ef4cb7 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:57.701497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 661/1316] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:48:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:48:57.710440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:57.710857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:57.711047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:57.776851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:48:57.778046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:57.882339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 656/1317] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:48:57.915618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab46cbc-282a-40cd-aeef-cf70b0ef4cb7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:48:57.917223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3ab46cbc-282a-40cd-aeef-cf70b0ef4cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:58.045911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab46cbc-282a-40cd-aeef-cf70b0ef4cb7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:48:58.143808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634c70d-0b7f-4512-b114-bc6a13d89c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:48:58.144762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634c70d-0b7f-4512-b114-bc6a13d89c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:58.145056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634c70d-0b7f-4512-b114-bc6a13d89c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:58.145324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634c70d-0b7f-4512-b114-bc6a13d89c3d admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:58.146265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634c70d-0b7f-4512-b114-bc6a13d89c3d admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:48:58.148078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634c70d-0b7f-4512-b114-bc6a13d89c3d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:48:58.149798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 662/1318] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:48:57 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:48:58.165063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:48:58.167347 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:58.265983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215a45-57b6-4167-8f4d-f07754e04d6d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:48:58.357466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:48:58.358023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:48:58.358293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:48:58.358558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:48:58.360179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:48:58.473121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:48:58.474556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686f95f-145f-4fd5-a740-b29a0b51324a service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:48:58.492661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 657/1319] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:00.967136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafd8dc-da90-4795-892d-6943f558f57c None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:00.967987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafd8dc-da90-4795-892d-6943f558f57c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:00.967987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafd8dc-da90-4795-892d-6943f558f57c None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:00.970865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 663/1320] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:00.979652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2b209-95b1-4310-8f1a-dc8395de44e8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:00.980083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2b209-95b1-4310-8f1a-dc8395de44e8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:00.980209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2b209-95b1-4310-8f1a-dc8395de44e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:01.049209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b4f2b209-95b1-4310-8f1a-dc8395de44e8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:01.050408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b4f2b209-95b1-4310-8f1a-dc8395de44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:01.147271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 658/1321] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:01.182403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafd8dc-da90-4795-892d-6943f558f57c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:01.184831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5dafd8dc-da90-4795-892d-6943f558f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:01.310280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafd8dc-da90-4795-892d-6943f558f57c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:01.402387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a698a5-baf7-492c-b12e-f024d5c5731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:01.403243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a698a5-baf7-492c-b12e-f024d5c5731b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:01.403511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a698a5-baf7-492c-b12e-f024d5c5731b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:01.403780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a698a5-baf7-492c-b12e-f024d5c5731b admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:01.413497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a698a5-baf7-492c-b12e-f024d5c5731b admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:01.415588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a698a5-baf7-492c-b12e-f024d5c5731b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:01.417291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 664/1322] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:49:01 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:49:01.445054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3b98c-289b-489f-a2eb-db5dd0915509 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:01.445315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3b98c-289b-489f-a2eb-db5dd0915509 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:01.445598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3b98c-289b-489f-a2eb-db5dd0915509 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:01.447402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 659/1323] 10.222.0.31 () {54 vars in 964 bytes} [Thu Feb 3 02:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:01.453151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275757-e8ee-4b1f-8055-66c6f83c3510 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:01.453434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275757-e8ee-4b1f-8055-66c6f83c3510 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:01.453699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275757-e8ee-4b1f-8055-66c6f83c3510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:01.535809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ea275757-e8ee-4b1f-8055-66c6f83c3510 None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:01.537046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ea275757-e8ee-4b1f-8055-66c6f83c3510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:01.612282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 665/1324] 10.222.0.31 () {58 vars in 1061 bytes} [Thu Feb 3 02:49:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:01.621480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3b98c-289b-489f-a2eb-db5dd0915509 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:01.623005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-abf3b98c-289b-489f-a2eb-db5dd0915509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:01.738027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3b98c-289b-489f-a2eb-db5dd0915509 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:01.808984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:01.809618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:01.809890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:01.810154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:01.811771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:01.927378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:01.928929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb3284-95ae-4bf9-85b8-6a99473e6df0 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:01.947224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 660/1325] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:05.017794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc503b2-dedb-46f2-a030-c5bae17ba632 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:05.018390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc503b2-dedb-46f2-a030-c5bae17ba632 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:05.018390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc503b2-dedb-46f2-a030-c5bae17ba632 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:05.020178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 666/1326] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:05.026720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:05.027435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:05.027643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:05.105001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:05.106600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:05.206913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 661/1327] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:05.241220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc503b2-dedb-46f2-a030-c5bae17ba632 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:05.242829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2bc503b2-dedb-46f2-a030-c5bae17ba632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:05.378018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc503b2-dedb-46f2-a030-c5bae17ba632 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:05.481048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b297d20-1aff-4e3e-9e31-a70778277838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:05.482638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b297d20-1aff-4e3e-9e31-a70778277838 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:05.482915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b297d20-1aff-4e3e-9e31-a70778277838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:05.483181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b297d20-1aff-4e3e-9e31-a70778277838 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:05.494843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b297d20-1aff-4e3e-9e31-a70778277838 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:05.498264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b297d20-1aff-4e3e-9e31-a70778277838 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:05.501154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 667/1328] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:49:05 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:49:05.513666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:05.514934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:05.603912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ec48-e111-4074-a865-e296a0d094f3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:05.681600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:05.682625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:05.683025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:05.683304 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:05.685292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:05.803767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:05.805285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646538a-1928-423b-b944-a4f6d1dd9a1c service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:05.823199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 662/1329] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:08.676303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e450d-5af7-4e64-a6ce-4fabe694f83a None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:08.676911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e450d-5af7-4e64-a6ce-4fabe694f83a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:08.676911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e450d-5af7-4e64-a6ce-4fabe694f83a None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:08.678674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 668/1330] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:08.684100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656863-190c-4dd6-aa43-41cc4d4605b5 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:08.684545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656863-190c-4dd6-aa43-41cc4d4605b5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:08.684635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656863-190c-4dd6-aa43-41cc4d4605b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:08.749193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4e656863-190c-4dd6-aa43-41cc4d4605b5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:08.750369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4e656863-190c-4dd6-aa43-41cc4d4605b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:08.849491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 663/1331] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:08.885400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e450d-5af7-4e64-a6ce-4fabe694f83a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:08.886957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-762e450d-5af7-4e64-a6ce-4fabe694f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:08.993465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e450d-5af7-4e64-a6ce-4fabe694f83a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:09.068272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:09.069074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:09.069351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:09.069615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:09.071303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:09.190330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:09.191796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405026f-60f7-4b71-8f34-3fecc1a9e323 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:09.213630 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 669/1332] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:11.460393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9527e4-aff5-4b1a-b609-e8f0d01f2874 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:11.461024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9527e4-aff5-4b1a-b609-e8f0d01f2874 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:11.461113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9527e4-aff5-4b1a-b609-e8f0d01f2874 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:11.462872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 664/1333] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:11.468601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4b52a-098a-40a6-a97d-d2b4fb68367f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:11.469118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4b52a-098a-40a6-a97d-d2b4fb68367f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:11.469217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4b52a-098a-40a6-a97d-d2b4fb68367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:11.537894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-16e4b52a-098a-40a6-a97d-d2b4fb68367f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:11.539348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-16e4b52a-098a-40a6-a97d-d2b4fb68367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:11.761436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 670/1334] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:49:11.796091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9527e4-aff5-4b1a-b609-e8f0d01f2874 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:11.797654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-bb9527e4-aff5-4b1a-b609-e8f0d01f2874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:11.904988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9527e4-aff5-4b1a-b609-e8f0d01f2874 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:12.106660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:12.107307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:12.107578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:12.107839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:12.109478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:12.220586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:12.222359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1821c7-1353-424f-98dc-d30fef78507b service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:12.240434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 665/1335] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:14.491856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620262b-39fe-45dc-916a-795b8a516116 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:14.492473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620262b-39fe-45dc-916a-795b8a516116 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:14.492473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620262b-39fe-45dc-916a-795b8a516116 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:14.494431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 671/1336] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:14.500034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:14.500534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:14.500534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:14.573061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:14.574301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:14.678220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 666/1337] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:49:14.709882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620262b-39fe-45dc-916a-795b8a516116 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:14.711442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e620262b-39fe-45dc-916a-795b8a516116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:14.834796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620262b-39fe-45dc-916a-795b8a516116 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:14.930793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2af09e-bae3-4bde-a0db-113e5f215f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:14.931668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2af09e-bae3-4bde-a0db-113e5f215f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:14.931921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2af09e-bae3-4bde-a0db-113e5f215f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:14.932221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2af09e-bae3-4bde-a0db-113e5f215f14 admin admin] PATH_INFO: `/v3/projects/d2de8007f03248b1ae1b7efb76862307` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:14.942813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2af09e-bae3-4bde-a0db-113e5f215f14 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2de8007f03248b1ae1b7efb76862307)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:14.944936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2af09e-bae3-4bde-a0db-113e5f215f14 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:14.946668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 672/1338] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:49:14 2022] GET /identity/v3/projects/d2de8007f03248b1ae1b7efb76862307 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:49:14.958443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:14.959651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:15.054389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e60304-b67d-45b0-bc7c-55ff4090a1e6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:15.128250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:15.128837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:15.129114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:15.129354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:15.130975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:15.246624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:15.248108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab2ba-65e3-4929-9a57-3efe94b0266e service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:15.269659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 667/1339] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:17.719835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be695a46-86bb-490b-a6e3-72180accec5d None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:17.720454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be695a46-86bb-490b-a6e3-72180accec5d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:17.720454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be695a46-86bb-490b-a6e3-72180accec5d None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:17.722234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 673/1340] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:17.727750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec54a-e89c-45db-8808-ca9573536eec None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:17.728201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec54a-e89c-45db-8808-ca9573536eec None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:17.728301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec54a-e89c-45db-8808-ca9573536eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:17.793081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c97ec54a-e89c-45db-8808-ca9573536eec None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:17.794314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c97ec54a-e89c-45db-8808-ca9573536eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:17.890578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 668/1341] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:17.926362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be695a46-86bb-490b-a6e3-72180accec5d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:17.928045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-be695a46-86bb-490b-a6e3-72180accec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:18.037724 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be695a46-86bb-490b-a6e3-72180accec5d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:18.115181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:18.115831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:18.116108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:18.116381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:18.118119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:18.226790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:18.228260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715560d4-3a84-41d0-b70b-c3fd4676596f service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:18.248265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 674/1342] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:20.504291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95942c08-5cff-4a11-95e1-371d1e39a11b None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:20.504786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95942c08-5cff-4a11-95e1-371d1e39a11b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:20.504881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95942c08-5cff-4a11-95e1-371d1e39a11b None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:20.506651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 669/1343] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:20.513075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:20.513817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:20.513817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:20.596959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:20.598152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:20.703291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 675/1344] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:20.738506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95942c08-5cff-4a11-95e1-371d1e39a11b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:20.752323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95942c08-5cff-4a11-95e1-371d1e39a11b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:20.757018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac617a45-e753-4886-a77f-cef68f9a342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:20.757903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617a45-e753-4886-a77f-cef68f9a342f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:20.758180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617a45-e753-4886-a77f-cef68f9a342f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:20.758448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617a45-e753-4886-a77f-cef68f9a342f admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:20.759685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac617a45-e753-4886-a77f-cef68f9a342f admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:20.761535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac617a45-e753-4886-a77f-cef68f9a342f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:20.763206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 670/1345] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:49:20 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:49:20.774850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:20.776300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:20.872325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1a377-196c-4149-b0a3-4f7927257542 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:20.876699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5425ab-7793-4c38-bc07-2d70999567a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:20.877369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5425ab-7793-4c38-bc07-2d70999567a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:20.877652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5425ab-7793-4c38-bc07-2d70999567a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:20.877921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5425ab-7793-4c38-bc07-2d70999567a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:20.887417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5425ab-7793-4c38-bc07-2d70999567a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:20.888869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5425ab-7793-4c38-bc07-2d70999567a7 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:20.898277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 676/1346] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:23.406105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce6c2f-3605-4eb2-a17a-29ebfd9ed392 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:23.406915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce6c2f-3605-4eb2-a17a-29ebfd9ed392 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:23.406915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce6c2f-3605-4eb2-a17a-29ebfd9ed392 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:23.409891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 671/1347] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:23.415230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c2d9-aed4-4d0c-b8cb-f54e1c1e87d0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:23.415676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c2d9-aed4-4d0c-b8cb-f54e1c1e87d0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:23.415774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c2d9-aed4-4d0c-b8cb-f54e1c1e87d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:23.434568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-78b4c2d9-aed4-4d0c-b8cb-f54e1c1e87d0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:23.435752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-78b4c2d9-aed4-4d0c-b8cb-f54e1c1e87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:23.444115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 677/1348] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:23.483300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce6c2f-3605-4eb2-a17a-29ebfd9ed392 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:23.498824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce6c2f-3605-4eb2-a17a-29ebfd9ed392 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:23.503374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e209026-b8cd-4d1f-8d70-c2205c4450bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:23.504008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e209026-b8cd-4d1f-8d70-c2205c4450bd service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:23.504293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e209026-b8cd-4d1f-8d70-c2205c4450bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:23.504591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e209026-b8cd-4d1f-8d70-c2205c4450bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:23.514503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e209026-b8cd-4d1f-8d70-c2205c4450bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:23.515982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e209026-b8cd-4d1f-8d70-c2205c4450bd service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:23.525700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 672/1349] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:27.645894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e8b8-ab4a-44b1-92c2-59e4f1d6c79a None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:27.646810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e8b8-ab4a-44b1-92c2-59e4f1d6c79a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:27.647092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e8b8-ab4a-44b1-92c2-59e4f1d6c79a None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:27.648993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 678/1350] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:27.654365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bebb3f-cdfb-4138-9e43-8f788b2ef77e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:27.654791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bebb3f-cdfb-4138-9e43-8f788b2ef77e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:27.654905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bebb3f-cdfb-4138-9e43-8f788b2ef77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:27.674127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c5bebb3f-cdfb-4138-9e43-8f788b2ef77e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:27.675249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c5bebb3f-cdfb-4138-9e43-8f788b2ef77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:27.684104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 673/1351] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:27.706800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e8b8-ab4a-44b1-92c2-59e4f1d6c79a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:27.719948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e8b8-ab4a-44b1-92c2-59e4f1d6c79a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:27.724865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866672e0-b4c0-4b49-86ad-fb67ef5e3824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:27.725528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866672e0-b4c0-4b49-86ad-fb67ef5e3824 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:27.725809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866672e0-b4c0-4b49-86ad-fb67ef5e3824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:27.726075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866672e0-b4c0-4b49-86ad-fb67ef5e3824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:27.726818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866672e0-b4c0-4b49-86ad-fb67ef5e3824 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:27.728675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866672e0-b4c0-4b49-86ad-fb67ef5e3824 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:27.743267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 679/1352] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:49:27 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:49:29.944998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde8e9-44a1-473f-ab83-24e34020ae20 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:29.945595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde8e9-44a1-473f-ab83-24e34020ae20 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:29.945595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde8e9-44a1-473f-ab83-24e34020ae20 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:29.947333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 674/1353] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:29.952691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:29.953154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:29.953246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:29.971916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:29.973148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:29.982249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 680/1354] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:30.015734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde8e9-44a1-473f-ab83-24e34020ae20 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:30.028754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde8e9-44a1-473f-ab83-24e34020ae20 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:30.033408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1fc4b-6cc5-476e-8f1f-b763b19eed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:30.034250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fc4b-6cc5-476e-8f1f-b763b19eed5c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:30.034530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fc4b-6cc5-476e-8f1f-b763b19eed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:30.034823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fc4b-6cc5-476e-8f1f-b763b19eed5c admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:30.036013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1fc4b-6cc5-476e-8f1f-b763b19eed5c admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:30.037859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1fc4b-6cc5-476e-8f1f-b763b19eed5c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:30.039556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 675/1355] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:49:30 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:49:30.051225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:30.052911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:30.068216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9bb0-9b88-4765-ad41-af796987bda4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:30.072883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03df41-2b2b-4dbc-857b-e6614e87320b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:30.073563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03df41-2b2b-4dbc-857b-e6614e87320b service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:30.073848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03df41-2b2b-4dbc-857b-e6614e87320b service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:30.074099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03df41-2b2b-4dbc-857b-e6614e87320b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:30.087027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03df41-2b2b-4dbc-857b-e6614e87320b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:30.088479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03df41-2b2b-4dbc-857b-e6614e87320b service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:30.098478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 681/1356] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:33.057951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6695d-c415-48ca-9e0a-27137545b5ad None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:33.058499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6695d-c415-48ca-9e0a-27137545b5ad None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:33.058499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6695d-c415-48ca-9e0a-27137545b5ad None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:33.060272 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 676/1357] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:33.065483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe840aa-5e78-41aa-9f5e-0cbcb5be62f3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:33.065900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe840aa-5e78-41aa-9f5e-0cbcb5be62f3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:33.066030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe840aa-5e78-41aa-9f5e-0cbcb5be62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:33.085154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-fbe840aa-5e78-41aa-9f5e-0cbcb5be62f3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:33.086356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-fbe840aa-5e78-41aa-9f5e-0cbcb5be62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:33.095675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 682/1358] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:33.133142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6695d-c415-48ca-9e0a-27137545b5ad None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:33.147766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6695d-c415-48ca-9e0a-27137545b5ad None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:33.154740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d44a-5fd5-4c2c-a480-ab18efde1b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:33.155389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d44a-5fd5-4c2c-a480-ab18efde1b21 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:33.155663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d44a-5fd5-4c2c-a480-ab18efde1b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:33.155925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d44a-5fd5-4c2c-a480-ab18efde1b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:33.166841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38d44a-5fd5-4c2c-a480-ab18efde1b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:33.168283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38d44a-5fd5-4c2c-a480-ab18efde1b21 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:33.177925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 677/1359] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:37.392467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077336-1fbe-4445-8a26-ee20e7d57fcd None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:37.393088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077336-1fbe-4445-8a26-ee20e7d57fcd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:37.393088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077336-1fbe-4445-8a26-ee20e7d57fcd None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:37.394857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 683/1360] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:37.400463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b05d9-4692-4cae-b1db-9ea3204d4734 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:37.400956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b05d9-4692-4cae-b1db-9ea3204d4734 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:37.401051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b05d9-4692-4cae-b1db-9ea3204d4734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:37.421192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8d1b05d9-4692-4cae-b1db-9ea3204d4734 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:37.422430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8d1b05d9-4692-4cae-b1db-9ea3204d4734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:37.431618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 678/1361] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:37.469528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077336-1fbe-4445-8a26-ee20e7d57fcd None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:37.481984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077336-1fbe-4445-8a26-ee20e7d57fcd None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:37.485731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68facc-9c4e-4945-be8e-824b518924de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:37.486319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68facc-9c4e-4945-be8e-824b518924de service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:37.486596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68facc-9c4e-4945-be8e-824b518924de service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:37.486883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68facc-9c4e-4945-be8e-824b518924de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:37.497076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68facc-9c4e-4945-be8e-824b518924de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:37.498576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68facc-9c4e-4945-be8e-824b518924de service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:37.508132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 684/1362] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:42.285802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bafe-d21b-4619-b46e-37a0d2bb439a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:42.286950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bafe-d21b-4619-b46e-37a0d2bb439a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:42.287491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bafe-d21b-4619-b46e-37a0d2bb439a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:42.289898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 679/1363] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 02:49:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:49:42.295665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb092-26a4-4ef3-b9cf-056d95104839 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:42.296089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb092-26a4-4ef3-b9cf-056d95104839 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:42.296196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb092-26a4-4ef3-b9cf-056d95104839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:42.404501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3f0bb092-26a4-4ef3-b9cf-056d95104839 None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:42.406043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3f0bb092-26a4-4ef3-b9cf-056d95104839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:42.479598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 685/1364] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 02:49:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:46.840417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a94ba-1859-48cd-aa4f-2b5df64c8197 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:46.841035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a94ba-1859-48cd-aa4f-2b5df64c8197 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:46.841035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a94ba-1859-48cd-aa4f-2b5df64c8197 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:46.842735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 680/1365] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 02:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:49:46.848026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b86dc-d6bd-40d4-9495-c063fd8aae27 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:46.848461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b86dc-d6bd-40d4-9495-c063fd8aae27 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:46.848564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b86dc-d6bd-40d4-9495-c063fd8aae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:46.867696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d74b86dc-d6bd-40d4-9495-c063fd8aae27 None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:46.868937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d74b86dc-d6bd-40d4-9495-c063fd8aae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:46.877632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 686/1366] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 02:49:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:48.144998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816f13d-0d23-4d0e-85a5-8ada993a11ad None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:48.145626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816f13d-0d23-4d0e-85a5-8ada993a11ad None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:48.145626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816f13d-0d23-4d0e-85a5-8ada993a11ad None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:48.147393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 681/1367] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 02:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:48.152616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327438ec-e740-4552-9760-fe3286d0e686 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:48.153087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327438ec-e740-4552-9760-fe3286d0e686 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:48.153264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327438ec-e740-4552-9760-fe3286d0e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:48.172018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-327438ec-e740-4552-9760-fe3286d0e686 None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:48.173241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-327438ec-e740-4552-9760-fe3286d0e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:48.182144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 687/1368] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 02:49:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:51.891744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9887-2828-4f53-9196-2d98e99b635b None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:51.892273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9887-2828-4f53-9196-2d98e99b635b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:51.892273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9887-2828-4f53-9196-2d98e99b635b None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:51.894261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 682/1369] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:51.899703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27c44-986d-4cf1-a153-92f0242fd815 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:51.900172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27c44-986d-4cf1-a153-92f0242fd815 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:51.900261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27c44-986d-4cf1-a153-92f0242fd815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:51.920247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-baa27c44-986d-4cf1-a153-92f0242fd815 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:51.921705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-baa27c44-986d-4cf1-a153-92f0242fd815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:51.931582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 688/1370] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:51.979565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f42a-93f6-403e-a091-c57bf7dfda95 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:51.979845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f42a-93f6-403e-a091-c57bf7dfda95 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:51.980311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f42a-93f6-403e-a091-c57bf7dfda95 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:51.982121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 683/1371] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 3 02:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:51.987651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955dbf-825c-433f-a1de-c1db070eb2d3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:51.988088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955dbf-825c-433f-a1de-c1db070eb2d3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:51.988559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955dbf-825c-433f-a1de-c1db070eb2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:52.036948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8b955dbf-825c-433f-a1de-c1db070eb2d3 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:52.038115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8b955dbf-825c-433f-a1de-c1db070eb2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:52.127945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 689/1372] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 3 02:49:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:52.135393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9f42a-93f6-403e-a091-c57bf7dfda95 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:52.153338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9f42a-93f6-403e-a091-c57bf7dfda95 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:52.160736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be12c-327c-498e-b511-74980861fd19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:52.161399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be12c-327c-498e-b511-74980861fd19 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:52.161939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be12c-327c-498e-b511-74980861fd19 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:52.162213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be12c-327c-498e-b511-74980861fd19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:52.171199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7be12c-327c-498e-b511-74980861fd19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:52.172810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7be12c-327c-498e-b511-74980861fd19 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:52.182703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 684/1373] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:54.598401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396494e-809e-4b61-b1eb-af9fd65fc640 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:54.599060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396494e-809e-4b61-b1eb-af9fd65fc640 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:54.599060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396494e-809e-4b61-b1eb-af9fd65fc640 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:54.604850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 690/1374] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:54.607063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317806d7-fc5c-4bc9-bc9b-2dfb06f787a8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:54.607507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317806d7-fc5c-4bc9-bc9b-2dfb06f787a8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:54.607600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317806d7-fc5c-4bc9-bc9b-2dfb06f787a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:54.627355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-317806d7-fc5c-4bc9-bc9b-2dfb06f787a8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:54.628991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-317806d7-fc5c-4bc9-bc9b-2dfb06f787a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:54.639166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 685/1375] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:54.681087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396494e-809e-4b61-b1eb-af9fd65fc640 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:54.696692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396494e-809e-4b61-b1eb-af9fd65fc640 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:54.702648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf92937-d225-40b0-a233-5f71ab76fb52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:54.703226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92937-d225-40b0-a233-5f71ab76fb52 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:54.703507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92937-d225-40b0-a233-5f71ab76fb52 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:54.703777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92937-d225-40b0-a233-5f71ab76fb52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:54.713375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf92937-d225-40b0-a233-5f71ab76fb52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:54.714970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf92937-d225-40b0-a233-5f71ab76fb52 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:54.724961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 691/1376] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:57.208585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed260-37a6-47c3-994d-136f9f02d5f2 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:57.209421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed260-37a6-47c3-994d-136f9f02d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:57.209707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed260-37a6-47c3-994d-136f9f02d5f2 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:57.211596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 686/1377] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:57.216997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b5152-a792-4f2f-ba7a-443c3321b0a2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:57.217453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b5152-a792-4f2f-ba7a-443c3321b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:57.217659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b5152-a792-4f2f-ba7a-443c3321b0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:57.236056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-381b5152-a792-4f2f-ba7a-443c3321b0a2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:57.237308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-381b5152-a792-4f2f-ba7a-443c3321b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:57.245681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 692/1378] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:57.290062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37a3aa-0915-4335-8f77-ee407f4ad4dd None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:57.290348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37a3aa-0915-4335-8f77-ee407f4ad4dd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:57.290629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37a3aa-0915-4335-8f77-ee407f4ad4dd None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:57.292386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 687/1379] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 3 02:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:57.297723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09511864-2c77-4047-8197-70c8641409ff None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:57.298090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09511864-2c77-4047-8197-70c8641409ff None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:57.298356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09511864-2c77-4047-8197-70c8641409ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:57.317725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-09511864-2c77-4047-8197-70c8641409ff None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:57.318921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-09511864-2c77-4047-8197-70c8641409ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:57.328776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 693/1380] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 3 02:49:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:49:57.336369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37a3aa-0915-4335-8f77-ee407f4ad4dd None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:57.351567 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37a3aa-0915-4335-8f77-ee407f4ad4dd None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:57.358126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b631f2-92b8-4564-8c29-ef1dbc7e7352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:57.358776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b631f2-92b8-4564-8c29-ef1dbc7e7352 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:57.359055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b631f2-92b8-4564-8c29-ef1dbc7e7352 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:57.359324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b631f2-92b8-4564-8c29-ef1dbc7e7352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:57.368144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b631f2-92b8-4564-8c29-ef1dbc7e7352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:57.369788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b631f2-92b8-4564-8c29-ef1dbc7e7352 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:57.379360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 688/1381] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:59.645382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb412e-5911-4118-bc89-580799742149 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:59.646458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb412e-5911-4118-bc89-580799742149 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:59.646807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb412e-5911-4118-bc89-580799742149 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:59.648947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 694/1382] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:59.654540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c480-ee00-4386-8b56-15cccc904eb9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:59.654974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c480-ee00-4386-8b56-15cccc904eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:59.655078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c480-ee00-4386-8b56-15cccc904eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:59.673704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4758c480-ee00-4386-8b56-15cccc904eb9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:59.674901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4758c480-ee00-4386-8b56-15cccc904eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:59.684931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 689/1383] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:49:59.727744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb412e-5911-4118-bc89-580799742149 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:49:59.743407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb412e-5911-4118-bc89-580799742149 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:49:59.749130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567b4e-4e11-41b4-8b79-f5a64ecf5dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:49:59.749770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567b4e-4e11-41b4-8b79-f5a64ecf5dfe service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:59.750055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567b4e-4e11-41b4-8b79-f5a64ecf5dfe service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:59.750432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567b4e-4e11-41b4-8b79-f5a64ecf5dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:59.761704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567b4e-4e11-41b4-8b79-f5a64ecf5dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:49:59.763334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567b4e-4e11-41b4-8b79-f5a64ecf5dfe service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:49:59.776234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 695/1384] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:49:59.822557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34050-1678-422a-ad14-4199b580d317 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:59.822868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34050-1678-422a-ad14-4199b580d317 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:59.823114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34050-1678-422a-ad14-4199b580d317 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:59.825012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 690/1385] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:49:59.831064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e87e0c-46d6-4d70-bfde-109a7f4b6bf6 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:49:59.831346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e87e0c-46d6-4d70-bfde-109a7f4b6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:49:59.831748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e87e0c-46d6-4d70-bfde-109a7f4b6bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:49:59.858312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-52e87e0c-46d6-4d70-bfde-109a7f4b6bf6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:49:59.859998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-52e87e0c-46d6-4d70-bfde-109a7f4b6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:49:59.869936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 696/1386] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:00.127086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a16a3-b750-410e-856e-895417ba8e22 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:00.127340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a16a3-b750-410e-856e-895417ba8e22 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:00.127602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a16a3-b750-410e-856e-895417ba8e22 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:00.129603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 691/1387] 10.222.0.31 () {54 vars in 963 bytes} [Thu Feb 3 02:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:50:00.135238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d002-abd1-4c41-8a58-058d9794c3ae None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:00.135500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d002-abd1-4c41-8a58-058d9794c3ae None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:00.135776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d002-abd1-4c41-8a58-058d9794c3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:00.190597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4508d002-abd1-4c41-8a58-058d9794c3ae None None] MFA Rules not processed for user `30865d753bcb4542bee3b1c86a14b51e`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:00.192064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4508d002-abd1-4c41-8a58-058d9794c3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:00.258176 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 697/1388] 10.222.0.31 () {58 vars in 1060 bytes} [Thu Feb 3 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:00.267355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a16a3-b750-410e-856e-895417ba8e22 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:00.278576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a16a3-b750-410e-856e-895417ba8e22 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:00.282399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a395750-b33d-47d4-9bd6-a9f488f54621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:00.283146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a395750-b33d-47d4-9bd6-a9f488f54621 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:00.283520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a395750-b33d-47d4-9bd6-a9f488f54621 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:00.283891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a395750-b33d-47d4-9bd6-a9f488f54621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:00.293541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a395750-b33d-47d4-9bd6-a9f488f54621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:00.295102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a395750-b33d-47d4-9bd6-a9f488f54621 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:00.305071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 692/1389] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:02.023661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb96a6e-8970-4a41-8971-209359fae0cb None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:02.024170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb96a6e-8970-4a41-8971-209359fae0cb None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:02.024286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb96a6e-8970-4a41-8971-209359fae0cb None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:02.026076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 698/1390] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:02.031539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce75b-c9cf-4b3e-a835-b4ca9d75a31c None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:02.032004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce75b-c9cf-4b3e-a835-b4ca9d75a31c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:02.032115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce75b-c9cf-4b3e-a835-b4ca9d75a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:02.051629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-e4fce75b-c9cf-4b3e-a835-b4ca9d75a31c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:02.053060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e4fce75b-c9cf-4b3e-a835-b4ca9d75a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:02.062003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 693/1391] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:02.106628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb96a6e-8970-4a41-8971-209359fae0cb None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:02.122725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb96a6e-8970-4a41-8971-209359fae0cb None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:02.129177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173f3f9-5b02-4f18-b045-dcc189328ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:02.129891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f3f9-5b02-4f18-b045-dcc189328ffa service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:02.130156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f3f9-5b02-4f18-b045-dcc189328ffa service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:02.130427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f3f9-5b02-4f18-b045-dcc189328ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:02.140453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173f3f9-5b02-4f18-b045-dcc189328ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:02.142222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173f3f9-5b02-4f18-b045-dcc189328ffa service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:02.153186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 699/1392] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:04.374116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a437a7-eafc-49af-a9a6-e487659aec58 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:04.374632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a437a7-eafc-49af-a9a6-e487659aec58 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:04.374632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a437a7-eafc-49af-a9a6-e487659aec58 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:04.376332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 694/1393] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:04.381939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf18b2-e587-4b8f-aaac-76f50f55108d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:04.382403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf18b2-e587-4b8f-aaac-76f50f55108d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:04.382496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf18b2-e587-4b8f-aaac-76f50f55108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:04.400626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6bdf18b2-e587-4b8f-aaac-76f50f55108d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:04.401810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6bdf18b2-e587-4b8f-aaac-76f50f55108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:04.410924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 700/1394] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:04.456445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a437a7-eafc-49af-a9a6-e487659aec58 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:04.474820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a437a7-eafc-49af-a9a6-e487659aec58 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:04.481572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6dbdf-a905-4b38-bcdd-614e9db4fc71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:04.482227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6dbdf-a905-4b38-bcdd-614e9db4fc71 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:04.482503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6dbdf-a905-4b38-bcdd-614e9db4fc71 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:04.482771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6dbdf-a905-4b38-bcdd-614e9db4fc71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:04.492614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6dbdf-a905-4b38-bcdd-614e9db4fc71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:04.494962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6dbdf-a905-4b38-bcdd-614e9db4fc71 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:04.506170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 695/1395] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:06.727793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ce4d-846b-49b7-ac60-64c9b8d6c50e None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:06.728761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ce4d-846b-49b7-ac60-64c9b8d6c50e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:06.728761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ce4d-846b-49b7-ac60-64c9b8d6c50e None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:06.730758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 701/1396] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:06.736043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551e57a-bb38-4fee-b43f-f618c1243603 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:06.736454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551e57a-bb38-4fee-b43f-f618c1243603 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:06.736596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551e57a-bb38-4fee-b43f-f618c1243603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:06.755852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4551e57a-bb38-4fee-b43f-f618c1243603 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:06.757063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4551e57a-bb38-4fee-b43f-f618c1243603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:06.765955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 696/1397] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:06.807435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ce4d-846b-49b7-ac60-64c9b8d6c50e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:06.823211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ce4d-846b-49b7-ac60-64c9b8d6c50e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:06.829380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850b6f8-4578-4be3-aeb8-54d89567aa48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:06.830026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b6f8-4578-4be3-aeb8-54d89567aa48 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:06.830300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b6f8-4578-4be3-aeb8-54d89567aa48 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:06.830663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b6f8-4578-4be3-aeb8-54d89567aa48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:06.839956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b6f8-4578-4be3-aeb8-54d89567aa48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:06.841602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b6f8-4578-4be3-aeb8-54d89567aa48 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:06.851264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 702/1398] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:09.122204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28158c8-8dc8-46c3-8b7b-5630fd3a2db8 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:09.122780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28158c8-8dc8-46c3-8b7b-5630fd3a2db8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:09.122780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28158c8-8dc8-46c3-8b7b-5630fd3a2db8 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:09.124666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 697/1399] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:09.131463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c3de8-3916-42a4-a82b-e191aded03e9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:09.131895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c3de8-3916-42a4-a82b-e191aded03e9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:09.132174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c3de8-3916-42a4-a82b-e191aded03e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:09.154978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-607c3de8-3916-42a4-a82b-e191aded03e9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:09.156297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-607c3de8-3916-42a4-a82b-e191aded03e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:09.166721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 703/1400] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:09.218248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28158c8-8dc8-46c3-8b7b-5630fd3a2db8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:09.234091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28158c8-8dc8-46c3-8b7b-5630fd3a2db8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:09.240157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1af6-255d-4222-a26c-8e897647b832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:09.240851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1af6-255d-4222-a26c-8e897647b832 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:09.241145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1af6-255d-4222-a26c-8e897647b832 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:09.241423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1af6-255d-4222-a26c-8e897647b832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:09.250136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1af6-255d-4222-a26c-8e897647b832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:09.251841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1af6-255d-4222-a26c-8e897647b832 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:09.262155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 698/1401] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:11.549688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b55e1-eb4d-4f15-a89e-b0f4cdf6f85f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:11.550272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b55e1-eb4d-4f15-a89e-b0f4cdf6f85f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:11.550413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b55e1-eb4d-4f15-a89e-b0f4cdf6f85f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:11.552832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 704/1402] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:11.559484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b3a3-fa7c-4f36-a79b-3b665acf2cd1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:11.560129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b3a3-fa7c-4f36-a79b-3b665acf2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:11.560129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b3a3-fa7c-4f36-a79b-3b665acf2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:11.578797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7179b3a3-fa7c-4f36-a79b-3b665acf2cd1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:11.580047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7179b3a3-fa7c-4f36-a79b-3b665acf2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:11.588746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 699/1403] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:11.647234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b55e1-eb4d-4f15-a89e-b0f4cdf6f85f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:11.666044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b55e1-eb4d-4f15-a89e-b0f4cdf6f85f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:11.672595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e2856-0f5f-42b1-8d6d-1bf5c67d02ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:11.673359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2856-0f5f-42b1-8d6d-1bf5c67d02ea service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:11.673628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2856-0f5f-42b1-8d6d-1bf5c67d02ea service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:11.673948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2856-0f5f-42b1-8d6d-1bf5c67d02ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:11.684267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e2856-0f5f-42b1-8d6d-1bf5c67d02ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:11.686464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e2856-0f5f-42b1-8d6d-1bf5c67d02ea service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:11.697066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 705/1404] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:50:13.951356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e004e-c120-4166-8ca3-131e2d895977 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:13.952082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e004e-c120-4166-8ca3-131e2d895977 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:13.952082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e004e-c120-4166-8ca3-131e2d895977 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:13.953945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 700/1405] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:13.959506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a084a-1418-4424-8f92-9d9bd67840e4 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:13.959996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a084a-1418-4424-8f92-9d9bd67840e4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:13.960109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a084a-1418-4424-8f92-9d9bd67840e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:13.979145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-234a084a-1418-4424-8f92-9d9bd67840e4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:13.980319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-234a084a-1418-4424-8f92-9d9bd67840e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:13.988684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 706/1406] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:14.034605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e004e-c120-4166-8ca3-131e2d895977 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:14.050714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e004e-c120-4166-8ca3-131e2d895977 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:14.056548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96dc09-f178-4459-a46e-7fe6464db8c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:14.057235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96dc09-f178-4459-a46e-7fe6464db8c4 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:14.057520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96dc09-f178-4459-a46e-7fe6464db8c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:14.057786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96dc09-f178-4459-a46e-7fe6464db8c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:14.066249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96dc09-f178-4459-a46e-7fe6464db8c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:14.068028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96dc09-f178-4459-a46e-7fe6464db8c4 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:14.078260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 701/1407] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:16.326113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec043c-112d-4bac-b429-bfcdc0e36ab3 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:16.326702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec043c-112d-4bac-b429-bfcdc0e36ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:16.326702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec043c-112d-4bac-b429-bfcdc0e36ab3 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:16.328446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 707/1408] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:16.333940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a25ef-44c3-4ebe-a904-65e93bdbcc48 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:16.334371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a25ef-44c3-4ebe-a904-65e93bdbcc48 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:16.334457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a25ef-44c3-4ebe-a904-65e93bdbcc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:16.353747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-491a25ef-44c3-4ebe-a904-65e93bdbcc48 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:16.354875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-491a25ef-44c3-4ebe-a904-65e93bdbcc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:16.363938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 702/1409] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:50:16.408243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec043c-112d-4bac-b429-bfcdc0e36ab3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:16.424672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec043c-112d-4bac-b429-bfcdc0e36ab3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:16.430692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fd92e-0d67-4a55-895a-e401ba27eef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:16.431340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd92e-0d67-4a55-895a-e401ba27eef5 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:16.431615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd92e-0d67-4a55-895a-e401ba27eef5 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:16.431885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd92e-0d67-4a55-895a-e401ba27eef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:16.440677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fd92e-0d67-4a55-895a-e401ba27eef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:16.442354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fd92e-0d67-4a55-895a-e401ba27eef5 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:16.451819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 708/1410] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:17.835024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed92b6-fd57-4367-ab5f-e71f87dba65b None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:17.835584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed92b6-fd57-4367-ab5f-e71f87dba65b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:17.835584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed92b6-fd57-4367-ab5f-e71f87dba65b None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:17.837556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 703/1411] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:17.842829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e174-17d4-48ae-922f-da557c63c399 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:17.843285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e174-17d4-48ae-922f-da557c63c399 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:17.843368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e174-17d4-48ae-922f-da557c63c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:17.862510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-adf0e174-17d4-48ae-922f-da557c63c399 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:17.863762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-adf0e174-17d4-48ae-922f-da557c63c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:17.871893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 709/1412] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:17.927363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902f12-6c5f-4aba-8535-b49e6f63e3f7 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:17.927649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902f12-6c5f-4aba-8535-b49e6f63e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:17.927919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902f12-6c5f-4aba-8535-b49e6f63e3f7 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:17.929785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 704/1413] 10.222.0.31 () {54 vars in 962 bytes} [Thu Feb 3 02:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:17.934721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7bc34-3402-4a03-9e4c-72011ef52fd0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:17.935004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7bc34-3402-4a03-9e4c-72011ef52fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:17.935270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7bc34-3402-4a03-9e4c-72011ef52fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:17.990834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4ac7bc34-3402-4a03-9e4c-72011ef52fd0 None None] MFA Rules not processed for user `3a83aa4460fb48469b62d1069358ec73`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:17.992020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4ac7bc34-3402-4a03-9e4c-72011ef52fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:18.049133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 710/1414] 10.222.0.31 () {58 vars in 1059 bytes} [Thu Feb 3 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:18.056505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902f12-6c5f-4aba-8535-b49e6f63e3f7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:18.071795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902f12-6c5f-4aba-8535-b49e6f63e3f7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:18.077153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29ef2a-17d2-4e53-974b-4f4eb66c3f15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:18.077812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29ef2a-17d2-4e53-974b-4f4eb66c3f15 service glance] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.078075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29ef2a-17d2-4e53-974b-4f4eb66c3f15 service glance] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.078339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29ef2a-17d2-4e53-974b-4f4eb66c3f15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.088988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29ef2a-17d2-4e53-974b-4f4eb66c3f15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:18.090384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29ef2a-17d2-4e53-974b-4f4eb66c3f15 service glance] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:18.100439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 705/1415] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:50:18.515143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b535f7-2d68-43ce-b8e6-6d00e1c8b676 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.515429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b535f7-2d68-43ce-b8e6-6d00e1c8b676 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.515700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b535f7-2d68-43ce-b8e6-6d00e1c8b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.569492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-23b535f7-2d68-43ce-b8e6-6d00e1c8b676 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:18.570731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-23b535f7-2d68-43ce-b8e6-6d00e1c8b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:18.635301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 711/1416] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:50:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:18.657627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9473-576c-4527-af65-60179550544f None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.657975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9473-576c-4527-af65-60179550544f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.658232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9473-576c-4527-af65-60179550544f None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.659969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 706/1417] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:18.666257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.666626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.666626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.683650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165004f9-7745-4caf-b364-28532faa94e2 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.684017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165004f9-7745-4caf-b364-28532faa94e2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.684354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165004f9-7745-4caf-b364-28532faa94e2 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.686270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 707/1418] 10.222.0.31 () {54 vars in 942 bytes} [Thu Feb 3 02:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:50:18.689405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:18.690624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:18.692502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d596-5c1e-4548-9de9-3285ff97f07c None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.692886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d596-5c1e-4548-9de9-3285ff97f07c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.693301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d596-5c1e-4548-9de9-3285ff97f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.699466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 712/1419] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:18.741476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7c22d596-5c1e-4548-9de9-3285ff97f07c None None] MFA Rules not processed for user `8951b6805c1d4f619c6fc26249eda16f`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:18.742665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7c22d596-5c1e-4548-9de9-3285ff97f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:18.742911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:18.754671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b046b8-d3fc-4285-a44a-8db5420ee3aa None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:18.760490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:18.761155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.761435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.761706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.770003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:18.771615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:18.780953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 713/1420] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:50:18.814297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 708/1421] 10.222.0.31 () {58 vars in 1039 bytes} [Thu Feb 3 02:50:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:18.828893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:18.840804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289e39-d36f-4fbc-9c78-c8d65a8cc876 service nova] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:18.846130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d529a-86f0-468f-acc0-c0ca7b9fa0a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:18.846773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d529a-86f0-468f-acc0-c0ca7b9fa0a8 service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:18.847079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d529a-86f0-468f-acc0-c0ca7b9fa0a8 service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:18.847391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d529a-86f0-468f-acc0-c0ca7b9fa0a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:18.856946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d529a-86f0-468f-acc0-c0ca7b9fa0a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:18.858584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d529a-86f0-468f-acc0-c0ca7b9fa0a8 service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:18.869014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 714/1422] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:50:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:50:40.775178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec9a4-0249-4ace-9708-694035ae42f6 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:40.775791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec9a4-0249-4ace-9708-694035ae42f6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:40.775791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec9a4-0249-4ace-9708-694035ae42f6 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:40.778466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 709/1423] 10.222.0.31 () {54 vars in 918 bytes} [Thu Feb 3 02:50:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:40.786138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5cf25-8d0c-46d1-94fb-b9b15f57fb08 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:40.786909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5cf25-8d0c-46d1-94fb-b9b15f57fb08 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:40.787093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5cf25-8d0c-46d1-94fb-b9b15f57fb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:40.806450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f4b5cf25-8d0c-46d1-94fb-b9b15f57fb08 None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:40.807656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f4b5cf25-8d0c-46d1-94fb-b9b15f57fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:40.817935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 715/1424] 10.222.0.31 () {58 vars in 1015 bytes} [Thu Feb 3 02:50:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:40.832941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fb31-958c-493c-80d0-38c2e9a48857 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:40.833385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fb31-958c-493c-80d0-38c2e9a48857 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:40.833758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fb31-958c-493c-80d0-38c2e9a48857 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:40.837044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 710/1425] 10.222.0.31 () {54 vars in 918 bytes} [Thu Feb 3 02:50:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:40.845207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41bb2-19b6-4488-977c-6bbfa3f0f478 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:40.845655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41bb2-19b6-4488-977c-6bbfa3f0f478 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:40.846224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41bb2-19b6-4488-977c-6bbfa3f0f478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:40.874757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3be41bb2-19b6-4488-977c-6bbfa3f0f478 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:40.876572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3be41bb2-19b6-4488-977c-6bbfa3f0f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:40.889576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 716/1426] 10.222.0.31 () {58 vars in 1015 bytes} [Thu Feb 3 02:50:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:43.578477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85838ee-19d9-473d-bbef-e0624a53335a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:43.579364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85838ee-19d9-473d-bbef-e0624a53335a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:43.579364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85838ee-19d9-473d-bbef-e0624a53335a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:43.581671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:50:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:43.587620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f6b0-706a-40c3-9a96-ecad6467190e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:43.588196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f6b0-706a-40c3-9a96-ecad6467190e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:43.588315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f6b0-706a-40c3-9a96-ecad6467190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:43.614483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-08e7f6b0-706a-40c3-9a96-ecad6467190e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:43.615690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-08e7f6b0-706a-40c3-9a96-ecad6467190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:43.626068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:43.668251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85838ee-19d9-473d-bbef-e0624a53335a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:43.688183 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85838ee-19d9-473d-bbef-e0624a53335a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:43.699171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ad2b2-736b-48db-b090-93f9c2658327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:43.700152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ad2b2-736b-48db-b090-93f9c2658327 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:43.700709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ad2b2-736b-48db-b090-93f9c2658327 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:43.701124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ad2b2-736b-48db-b090-93f9c2658327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:43.711824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ad2b2-736b-48db-b090-93f9c2658327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:43.713470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ad2b2-736b-48db-b090-93f9c2658327 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:43.722880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 712/1429] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:45.062362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58165-ca04-4d4e-ab0f-a40c3a0cd404 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:45.063193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58165-ca04-4d4e-ab0f-a40c3a0cd404 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:45.063193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58165-ca04-4d4e-ab0f-a40c3a0cd404 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:45.066063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:45.071879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ffc1-0fbc-40fd-a9d8-5c8525d19a04 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:45.072354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ffc1-0fbc-40fd-a9d8-5c8525d19a04 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:45.072450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ffc1-0fbc-40fd-a9d8-5c8525d19a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:45.096184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b395ffc1-0fbc-40fd-a9d8-5c8525d19a04 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:45.097433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b395ffc1-0fbc-40fd-a9d8-5c8525d19a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:45.107257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:45.258764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58165-ca04-4d4e-ab0f-a40c3a0cd404 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:45.275736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58165-ca04-4d4e-ab0f-a40c3a0cd404 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:45.283286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92773a1-2e16-40b1-a383-a0445b3d54d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:45.284034 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92773a1-2e16-40b1-a383-a0445b3d54d9 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:45.284309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92773a1-2e16-40b1-a383-a0445b3d54d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:45.284570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92773a1-2e16-40b1-a383-a0445b3d54d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:45.293448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92773a1-2e16-40b1-a383-a0445b3d54d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:45.295056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92773a1-2e16-40b1-a383-a0445b3d54d9 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:45.304696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 719/1432] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:46.603467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767524-784c-428e-9f6b-37531ea23f9c None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:46.604422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767524-784c-428e-9f6b-37531ea23f9c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:46.604422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767524-784c-428e-9f6b-37531ea23f9c None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:46.607682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:46.613935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ea262-207f-47a8-a3b5-5cde42e4d2bc None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:46.614408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ea262-207f-47a8-a3b5-5cde42e4d2bc None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:46.614408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ea262-207f-47a8-a3b5-5cde42e4d2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:46.635483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-561ea262-207f-47a8-a3b5-5cde42e4d2bc None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:46.636674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-561ea262-207f-47a8-a3b5-5cde42e4d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:46.652342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:46.816668 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767524-784c-428e-9f6b-37531ea23f9c None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:46.832043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767524-784c-428e-9f6b-37531ea23f9c None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:46.838480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a5881-c6c3-48c7-a380-edf8967b6b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:46.839110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5881-c6c3-48c7-a380-edf8967b6b95 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:46.839381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5881-c6c3-48c7-a380-edf8967b6b95 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:46.839643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5881-c6c3-48c7-a380-edf8967b6b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:46.849058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a5881-c6c3-48c7-a380-edf8967b6b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:46.850654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a5881-c6c3-48c7-a380-edf8967b6b95 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:46.860832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 715/1435] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:48.161073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d1be7-5677-428b-a44c-13d4932e00f4 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:48.161648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d1be7-5677-428b-a44c-13d4932e00f4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:48.161648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d1be7-5677-428b-a44c-13d4932e00f4 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:48.163405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:48.169560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ab8b-7701-4102-b5af-6c2685e3dba0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:48.170348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ab8b-7701-4102-b5af-6c2685e3dba0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:48.170495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ab8b-7701-4102-b5af-6c2685e3dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:48.198985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-dc05ab8b-7701-4102-b5af-6c2685e3dba0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:48.200620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-dc05ab8b-7701-4102-b5af-6c2685e3dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:48.211250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:48.366418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d1be7-5677-428b-a44c-13d4932e00f4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:48.382615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d1be7-5677-428b-a44c-13d4932e00f4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:48.388601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde466f-2928-4708-91c7-149aa49ce1cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:48.389264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde466f-2928-4708-91c7-149aa49ce1cd service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:48.389534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde466f-2928-4708-91c7-149aa49ce1cd service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:48.389803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde466f-2928-4708-91c7-149aa49ce1cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:48.398056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde466f-2928-4708-91c7-149aa49ce1cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:48.399674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde466f-2928-4708-91c7-149aa49ce1cd service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:48.409230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 722/1438] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:49.705482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8f2a-cc35-4a1c-bb84-9ea41fc655fc None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:49.706076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8f2a-cc35-4a1c-bb84-9ea41fc655fc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:49.706076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8f2a-cc35-4a1c-bb84-9ea41fc655fc None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:49.707907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:49.712983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980dc7-2da6-4f03-9965-402555ae1611 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:49.713460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980dc7-2da6-4f03-9965-402555ae1611 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:49.713562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980dc7-2da6-4f03-9965-402555ae1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:49.732766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0c980dc7-2da6-4f03-9965-402555ae1611 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:49.733944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0c980dc7-2da6-4f03-9965-402555ae1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:49.742574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:49.896992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8f2a-cc35-4a1c-bb84-9ea41fc655fc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:49.918036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8f2a-cc35-4a1c-bb84-9ea41fc655fc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:49.924532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3257583-8a9f-4602-a22d-106a3d000fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:49.925198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257583-8a9f-4602-a22d-106a3d000fa2 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:49.925474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257583-8a9f-4602-a22d-106a3d000fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:49.925744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257583-8a9f-4602-a22d-106a3d000fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:49.933846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3257583-8a9f-4602-a22d-106a3d000fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:49.935435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3257583-8a9f-4602-a22d-106a3d000fa2 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:49.945321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 718/1441] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:51.181515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1102b-3032-4eb3-9458-0d646633daae None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:51.182364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1102b-3032-4eb3-9458-0d646633daae None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:51.182364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1102b-3032-4eb3-9458-0d646633daae None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:51.185432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:51.193695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9ddf-7f60-4bde-91c9-e56acbbb3e37 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:51.194388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9ddf-7f60-4bde-91c9-e56acbbb3e37 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:51.194537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9ddf-7f60-4bde-91c9-e56acbbb3e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:51.217404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2cad9ddf-7f60-4bde-91c9-e56acbbb3e37 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:51.218614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2cad9ddf-7f60-4bde-91c9-e56acbbb3e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:51.227276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:51.382414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1102b-3032-4eb3-9458-0d646633daae None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:51.405340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1102b-3032-4eb3-9458-0d646633daae None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:51.412181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3326c-98a2-45db-93b5-f36bf25424cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:51.412838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3326c-98a2-45db-93b5-f36bf25424cf service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:51.413116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3326c-98a2-45db-93b5-f36bf25424cf service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:51.413380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3326c-98a2-45db-93b5-f36bf25424cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:51.421634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3326c-98a2-45db-93b5-f36bf25424cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:51.423222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3326c-98a2-45db-93b5-f36bf25424cf service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:51.433009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 725/1444] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:52.667791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7999e-0c4f-43a0-8ad4-95b54720585a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:52.668246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7999e-0c4f-43a0-8ad4-95b54720585a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:52.668341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7999e-0c4f-43a0-8ad4-95b54720585a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:52.670186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:52.675778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037576-c40a-4661-851b-70b0def39c02 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:52.676253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037576-c40a-4661-851b-70b0def39c02 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:52.676345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037576-c40a-4661-851b-70b0def39c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:52.700912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9a037576-c40a-4661-851b-70b0def39c02 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:52.702800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9a037576-c40a-4661-851b-70b0def39c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:52.713644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:52.869317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7999e-0c4f-43a0-8ad4-95b54720585a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:52.889219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7999e-0c4f-43a0-8ad4-95b54720585a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:52.896584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f067575-2d88-4e38-9893-388a41030464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:52.897200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067575-2d88-4e38-9893-388a41030464 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:52.897524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067575-2d88-4e38-9893-388a41030464 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:52.897799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067575-2d88-4e38-9893-388a41030464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:52.906246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f067575-2d88-4e38-9893-388a41030464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:52.907848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f067575-2d88-4e38-9893-388a41030464 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:52.917551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 721/1447] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:54.161978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203a78-0e53-4dea-b21c-cba55cd14582 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:54.162606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203a78-0e53-4dea-b21c-cba55cd14582 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:54.162606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203a78-0e53-4dea-b21c-cba55cd14582 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:54.165273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:54.173325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91bb9-defb-4e8f-8f86-2b10c79df9b1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:54.173793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91bb9-defb-4e8f-8f86-2b10c79df9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:54.173913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91bb9-defb-4e8f-8f86-2b10c79df9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:54.193818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a9d91bb9-defb-4e8f-8f86-2b10c79df9b1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:54.195027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a9d91bb9-defb-4e8f-8f86-2b10c79df9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:54.203874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:54.356822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203a78-0e53-4dea-b21c-cba55cd14582 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:54.381159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203a78-0e53-4dea-b21c-cba55cd14582 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:54.387762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc15e-554c-40e3-a3ee-49f8cb940d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:54.388413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc15e-554c-40e3-a3ee-49f8cb940d3a service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:54.388676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc15e-554c-40e3-a3ee-49f8cb940d3a service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:54.388974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc15e-554c-40e3-a3ee-49f8cb940d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:54.398748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddc15e-554c-40e3-a3ee-49f8cb940d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:54.400347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddc15e-554c-40e3-a3ee-49f8cb940d3a service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:54.410782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 728/1450] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:55.662022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f92294-59dc-46bc-8b0f-f7196ae5b06e None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:55.662922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f92294-59dc-46bc-8b0f-f7196ae5b06e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:55.662922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f92294-59dc-46bc-8b0f-f7196ae5b06e None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:55.665855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:50:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:55.671063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac75037-189f-46bb-b5ec-91bf559a7668 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:55.671504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac75037-189f-46bb-b5ec-91bf559a7668 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:55.671599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac75037-189f-46bb-b5ec-91bf559a7668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:55.690398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7ac75037-189f-46bb-b5ec-91bf559a7668 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:55.691583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7ac75037-189f-46bb-b5ec-91bf559a7668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:55.702192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:55.855155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f92294-59dc-46bc-8b0f-f7196ae5b06e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:55.879696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f92294-59dc-46bc-8b0f-f7196ae5b06e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:55.886380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd816e0-b8e4-4b8a-80a0-15a7290a84c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:55.887009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd816e0-b8e4-4b8a-80a0-15a7290a84c6 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:55.887284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd816e0-b8e4-4b8a-80a0-15a7290a84c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:55.887549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd816e0-b8e4-4b8a-80a0-15a7290a84c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:55.895786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd816e0-b8e4-4b8a-80a0-15a7290a84c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:55.897410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd816e0-b8e4-4b8a-80a0-15a7290a84c6 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:55.906693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 724/1453] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:57.949031 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781d5cc-d124-4134-a0e3-946d8928fa68 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:57.949640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781d5cc-d124-4134-a0e3-946d8928fa68 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:57.949640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781d5cc-d124-4134-a0e3-946d8928fa68 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:57.951374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:50:57.957937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28f09-faed-4bf6-b022-03b0b1a1fa62 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:57.958648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28f09-faed-4bf6-b022-03b0b1a1fa62 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:57.958910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28f09-faed-4bf6-b022-03b0b1a1fa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:57.987942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d9c28f09-faed-4bf6-b022-03b0b1a1fa62 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:50:57.989166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d9c28f09-faed-4bf6-b022-03b0b1a1fa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:50:57.998005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:50:58.036247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781d5cc-d124-4134-a0e3-946d8928fa68 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:50:58.047170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781d5cc-d124-4134-a0e3-946d8928fa68 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:50:58.051371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fda7b-ff22-4221-8411-40962a514a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:50:58.052002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fda7b-ff22-4221-8411-40962a514a74 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:50:58.052280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fda7b-ff22-4221-8411-40962a514a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:50:58.052546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fda7b-ff22-4221-8411-40962a514a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:50:58.062028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fda7b-ff22-4221-8411-40962a514a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:50:58.063472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fda7b-ff22-4221-8411-40962a514a74 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:50:58.073456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 731/1456] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:00.410821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82325222-24b0-49ea-80bb-c6d747509c66 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:00.411706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82325222-24b0-49ea-80bb-c6d747509c66 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:00.411706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82325222-24b0-49ea-80bb-c6d747509c66 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:00.414758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:00.421094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d033-e13f-439b-9689-6c7ec7119f92 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:00.421548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d033-e13f-439b-9689-6c7ec7119f92 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:00.421659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d033-e13f-439b-9689-6c7ec7119f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:00.445414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-30e3d033-e13f-439b-9689-6c7ec7119f92 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:00.446611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-30e3d033-e13f-439b-9689-6c7ec7119f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:00.454908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:00.498218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82325222-24b0-49ea-80bb-c6d747509c66 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:00.512076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82325222-24b0-49ea-80bb-c6d747509c66 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:00.516149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c064b2-20dd-4cbe-8aa2-b2768246a33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:00.516808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c064b2-20dd-4cbe-8aa2-b2768246a33e service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:00.517080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c064b2-20dd-4cbe-8aa2-b2768246a33e service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:00.517350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c064b2-20dd-4cbe-8aa2-b2768246a33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:00.526676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c064b2-20dd-4cbe-8aa2-b2768246a33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:00.528109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c064b2-20dd-4cbe-8aa2-b2768246a33e service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:00.537617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 727/1459] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:03.054344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad45cb-90ae-4112-8dfe-b3373d496125 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:03.054933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad45cb-90ae-4112-8dfe-b3373d496125 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:03.054933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad45cb-90ae-4112-8dfe-b3373d496125 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:03.056604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:03.067169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67003-b2d6-4c61-8f55-b0150b6d0c1e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:03.067655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67003-b2d6-4c61-8f55-b0150b6d0c1e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:03.067881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67003-b2d6-4c61-8f55-b0150b6d0c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:03.087881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0bb67003-b2d6-4c61-8f55-b0150b6d0c1e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:03.089107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0bb67003-b2d6-4c61-8f55-b0150b6d0c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:03.097380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:03.135941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad45cb-90ae-4112-8dfe-b3373d496125 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:03.148766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad45cb-90ae-4112-8dfe-b3373d496125 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:03.153431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecc7f3-9cb3-40d5-8afe-9865a67b9994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:03.154070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc7f3-9cb3-40d5-8afe-9865a67b9994 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:03.154347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc7f3-9cb3-40d5-8afe-9865a67b9994 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:03.154615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc7f3-9cb3-40d5-8afe-9865a67b9994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:03.164242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecc7f3-9cb3-40d5-8afe-9865a67b9994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:03.165729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecc7f3-9cb3-40d5-8afe-9865a67b9994 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:03.175257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 734/1462] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:05.484176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ee7aa-72c5-4478-b78e-c2431a90c554 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:05.485122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ee7aa-72c5-4478-b78e-c2431a90c554 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:05.485122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ee7aa-72c5-4478-b78e-c2431a90c554 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:05.487690 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:05.494108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2752-df5f-4be7-ab32-5ec314b20e04 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:05.494576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2752-df5f-4be7-ab32-5ec314b20e04 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:05.494679 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2752-df5f-4be7-ab32-5ec314b20e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:05.516281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-79af2752-df5f-4be7-ab32-5ec314b20e04 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:05.517526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-79af2752-df5f-4be7-ab32-5ec314b20e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:05.526820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:05.565138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ee7aa-72c5-4478-b78e-c2431a90c554 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:05.576989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ee7aa-72c5-4478-b78e-c2431a90c554 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:05.581350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc53f-8dee-463e-a4e9-93da9fb81b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:05.581993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc53f-8dee-463e-a4e9-93da9fb81b14 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:05.582294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc53f-8dee-463e-a4e9-93da9fb81b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:05.582562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc53f-8dee-463e-a4e9-93da9fb81b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:05.592477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc53f-8dee-463e-a4e9-93da9fb81b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:05.593966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc53f-8dee-463e-a4e9-93da9fb81b14 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:05.604172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 730/1465] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:07.851004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe797d-da2a-49c2-aac0-aa3f4925e570 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:07.851871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe797d-da2a-49c2-aac0-aa3f4925e570 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:07.851871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe797d-da2a-49c2-aac0-aa3f4925e570 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:07.855209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:07.860870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a643-9688-4879-86ad-b1d746aa749e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:07.861315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a643-9688-4879-86ad-b1d746aa749e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:07.861409 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a643-9688-4879-86ad-b1d746aa749e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:07.886353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4807a643-9688-4879-86ad-b1d746aa749e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:07.887536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4807a643-9688-4879-86ad-b1d746aa749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:07.896679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:07.937466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe797d-da2a-49c2-aac0-aa3f4925e570 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:07.949461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe797d-da2a-49c2-aac0-aa3f4925e570 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:07.953662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e2a59-9a49-4ca7-8465-45348d2e078f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:07.954296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2a59-9a49-4ca7-8465-45348d2e078f service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:07.954578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2a59-9a49-4ca7-8465-45348d2e078f service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:07.954842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2a59-9a49-4ca7-8465-45348d2e078f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:07.964374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e2a59-9a49-4ca7-8465-45348d2e078f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:07.965868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e2a59-9a49-4ca7-8465-45348d2e078f service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:07.974907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 737/1468] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:51:10.209458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde48f-2def-434e-8fe1-abf4806c82a1 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:10.210375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde48f-2def-434e-8fe1-abf4806c82a1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:10.210375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde48f-2def-434e-8fe1-abf4806c82a1 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:10.213317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:10.221990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cc39f-128c-41c0-b709-cadfc17c5007 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:10.222401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cc39f-128c-41c0-b709-cadfc17c5007 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:10.222535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cc39f-128c-41c0-b709-cadfc17c5007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:10.241876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-410cc39f-128c-41c0-b709-cadfc17c5007 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:10.243026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-410cc39f-128c-41c0-b709-cadfc17c5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:10.251592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:10.293209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebde48f-2def-434e-8fe1-abf4806c82a1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:10.310116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebde48f-2def-434e-8fe1-abf4806c82a1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:10.315293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227697cd-d95e-4b1b-9394-b03795290efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:10.315932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227697cd-d95e-4b1b-9394-b03795290efa service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:10.316211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227697cd-d95e-4b1b-9394-b03795290efa service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:10.316480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227697cd-d95e-4b1b-9394-b03795290efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:10.326784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227697cd-d95e-4b1b-9394-b03795290efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:10.328227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227697cd-d95e-4b1b-9394-b03795290efa service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:10.338153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 733/1471] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:12.573950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401674f-4b7b-41ce-a0fc-e46d878f878b None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:12.574551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401674f-4b7b-41ce-a0fc-e46d878f878b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:12.574551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401674f-4b7b-41ce-a0fc-e46d878f878b None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:12.576291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 739/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:12.584902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc35f6c-dda2-43e0-92d0-655ae61caf12 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:12.585684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc35f6c-dda2-43e0-92d0-655ae61caf12 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:12.585837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc35f6c-dda2-43e0-92d0-655ae61caf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:12.609062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1bc35f6c-dda2-43e0-92d0-655ae61caf12 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:12.610258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1bc35f6c-dda2-43e0-92d0-655ae61caf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:12.619464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 734/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:12.659888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401674f-4b7b-41ce-a0fc-e46d878f878b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:12.672512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401674f-4b7b-41ce-a0fc-e46d878f878b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:12.676750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1ef4-a83e-48f4-84bc-23c3dde30c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:12.677394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1ef4-a83e-48f4-84bc-23c3dde30c4c service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:12.677673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1ef4-a83e-48f4-84bc-23c3dde30c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:12.677943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1ef4-a83e-48f4-84bc-23c3dde30c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:12.686971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac1ef4-a83e-48f4-84bc-23c3dde30c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:12.688416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac1ef4-a83e-48f4-84bc-23c3dde30c4c service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:12.697830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 740/1474] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:14.920513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed965-2fb6-41c1-8910-abd68f6f4b24 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:14.921086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed965-2fb6-41c1-8910-abd68f6f4b24 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:14.921086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed965-2fb6-41c1-8910-abd68f6f4b24 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:14.922800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 735/1475] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:14.929431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210217b-f1d6-49e6-8bb5-16cd7b93a536 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:14.930159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210217b-f1d6-49e6-8bb5-16cd7b93a536 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:14.930266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210217b-f1d6-49e6-8bb5-16cd7b93a536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:14.958430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8210217b-f1d6-49e6-8bb5-16cd7b93a536 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:14.959610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8210217b-f1d6-49e6-8bb5-16cd7b93a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:14.969108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 741/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:15.006228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ed965-2fb6-41c1-8910-abd68f6f4b24 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:15.017735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ed965-2fb6-41c1-8910-abd68f6f4b24 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:15.023861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc534d2-418c-48e2-a579-c9d50e38fc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:15.024786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc534d2-418c-48e2-a579-c9d50e38fc29 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:15.025166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc534d2-418c-48e2-a579-c9d50e38fc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:15.025520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc534d2-418c-48e2-a579-c9d50e38fc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:15.038355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc534d2-418c-48e2-a579-c9d50e38fc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:15.039790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc534d2-418c-48e2-a579-c9d50e38fc29 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:15.049129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 736/1477] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:51:17.281871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2efb1-f096-4dff-ae28-dcb0206ee08c None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:17.282769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2efb1-f096-4dff-ae28-dcb0206ee08c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:17.282769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2efb1-f096-4dff-ae28-dcb0206ee08c None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:17.285833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 742/1478] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:17.292286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb78bf-5db5-4fdd-9236-ff88b39a0c3f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:17.293220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb78bf-5db5-4fdd-9236-ff88b39a0c3f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:17.293220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb78bf-5db5-4fdd-9236-ff88b39a0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:17.314830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c9eb78bf-5db5-4fdd-9236-ff88b39a0c3f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:17.316025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c9eb78bf-5db5-4fdd-9236-ff88b39a0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:17.324918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 737/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:17.361735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2efb1-f096-4dff-ae28-dcb0206ee08c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:17.373846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2efb1-f096-4dff-ae28-dcb0206ee08c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:17.377989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4be3-7c19-47af-a3c4-f9db16fbefe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:17.378634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4be3-7c19-47af-a3c4-f9db16fbefe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:17.378920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4be3-7c19-47af-a3c4-f9db16fbefe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:17.379202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4be3-7c19-47af-a3c4-f9db16fbefe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:17.388737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4be3-7c19-47af-a3c4-f9db16fbefe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:17.390191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4be3-7c19-47af-a3c4-f9db16fbefe9 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:17.399699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 743/1480] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:19.590227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21318d-d0a6-4977-a4ee-677d5b9315bc None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:19.590791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21318d-d0a6-4977-a4ee-677d5b9315bc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:19.590791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21318d-d0a6-4977-a4ee-677d5b9315bc None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:19.592575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 738/1481] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:19.599094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abf54-781e-46cf-af34-c872f8b50da0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:19.599826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abf54-781e-46cf-af34-c872f8b50da0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:19.599984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abf54-781e-46cf-af34-c872f8b50da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:19.623958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-cb2abf54-781e-46cf-af34-c872f8b50da0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:19.625211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cb2abf54-781e-46cf-af34-c872f8b50da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:19.635625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 744/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:19.675142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21318d-d0a6-4977-a4ee-677d5b9315bc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:19.688085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21318d-d0a6-4977-a4ee-677d5b9315bc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:19.692954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770cc98-89c7-4732-b7c4-0d09050f08c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:19.693597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cc98-89c7-4732-b7c4-0d09050f08c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:19.693871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cc98-89c7-4732-b7c4-0d09050f08c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:19.694141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cc98-89c7-4732-b7c4-0d09050f08c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:19.704258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770cc98-89c7-4732-b7c4-0d09050f08c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:19.705852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770cc98-89c7-4732-b7c4-0d09050f08c4 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:19.715568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 739/1483] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:36.268986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0472c-464c-4199-a3f9-2e425c9fb633 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:36.269893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0472c-464c-4199-a3f9-2e425c9fb633 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:36.269893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0472c-464c-4199-a3f9-2e425c9fb633 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:36.272663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 745/1484] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:36.280614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b56ab-3ead-4d73-b762-22b8c9814204 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:36.281110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b56ab-3ead-4d73-b762-22b8c9814204 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:36.281226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b56ab-3ead-4d73-b762-22b8c9814204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:36.299371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-fd4b56ab-3ead-4d73-b762-22b8c9814204 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:36.300572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-fd4b56ab-3ead-4d73-b762-22b8c9814204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:36.308784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 740/1485] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:51:36.358339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c509-4584-46be-856e-d03cf3c67c0f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:36.358592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c509-4584-46be-856e-d03cf3c67c0f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:36.358872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c509-4584-46be-856e-d03cf3c67c0f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:36.360656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 746/1486] 10.222.0.31 () {54 vars in 962 bytes} [Thu Feb 3 02:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:36.365495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4b45-d6a1-47b9-bb73-942d469735ad None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:36.365784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4b45-d6a1-47b9-bb73-942d469735ad None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:36.366054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4b45-d6a1-47b9-bb73-942d469735ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:36.385603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-5c2c4b45-d6a1-47b9-bb73-942d469735ad None None] MFA Rules not processed for user `3a83aa4460fb48469b62d1069358ec73`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:36.386824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5c2c4b45-d6a1-47b9-bb73-942d469735ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:36.394461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 741/1487] 10.222.0.31 () {58 vars in 1059 bytes} [Thu Feb 3 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:36.401685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43c509-4584-46be-856e-d03cf3c67c0f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:36.413922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43c509-4584-46be-856e-d03cf3c67c0f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:36.418274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062d6ba-0fd8-4c2f-9af5-91b3f34d2189 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:36.418893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062d6ba-0fd8-4c2f-9af5-91b3f34d2189 service glance] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:36.419152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062d6ba-0fd8-4c2f-9af5-91b3f34d2189 service glance] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:36.419420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062d6ba-0fd8-4c2f-9af5-91b3f34d2189 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:36.429057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062d6ba-0fd8-4c2f-9af5-91b3f34d2189 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:36.430523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062d6ba-0fd8-4c2f-9af5-91b3f34d2189 service glance] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:36.440227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 747/1488] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:38.711165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b449da-3833-4fbd-ad0b-7644bc2d5945 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:38.711685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b449da-3833-4fbd-ad0b-7644bc2d5945 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:38.711685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b449da-3833-4fbd-ad0b-7644bc2d5945 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:38.713575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 742/1489] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:38.720175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38199a8-f3ab-43e4-99df-a1a4feb99b93 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:38.720880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38199a8-f3ab-43e4-99df-a1a4feb99b93 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:38.721018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38199a8-f3ab-43e4-99df-a1a4feb99b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:38.740592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b38199a8-f3ab-43e4-99df-a1a4feb99b93 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:38.741796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b38199a8-f3ab-43e4-99df-a1a4feb99b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:38.750979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 748/1490] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:38.786733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b449da-3833-4fbd-ad0b-7644bc2d5945 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:38.801049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b449da-3833-4fbd-ad0b-7644bc2d5945 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:38.806766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc35095-ef83-498d-a2a0-6df0096f3ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:38.807403 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc35095-ef83-498d-a2a0-6df0096f3ded admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:38.807673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc35095-ef83-498d-a2a0-6df0096f3ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:38.807908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc35095-ef83-498d-a2a0-6df0096f3ded admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:38.808667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc35095-ef83-498d-a2a0-6df0096f3ded admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:38.810557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc35095-ef83-498d-a2a0-6df0096f3ded admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:38.824844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 743/1491] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 3 02:51:38 2022] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:51:41.007354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b4b3a-01d0-4691-9a76-7d63376dda30 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:41.008288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b4b3a-01d0-4691-9a76-7d63376dda30 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:41.008288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b4b3a-01d0-4691-9a76-7d63376dda30 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:41.011149 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 749/1492] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:41.016702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1745c61-9a86-4933-b21e-2a9031fe79c4 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:41.017171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1745c61-9a86-4933-b21e-2a9031fe79c4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:41.017266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1745c61-9a86-4933-b21e-2a9031fe79c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:41.036427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f1745c61-9a86-4933-b21e-2a9031fe79c4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:41.037658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f1745c61-9a86-4933-b21e-2a9031fe79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:41.045887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 744/1493] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:41.096206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b4b3a-01d0-4691-9a76-7d63376dda30 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:41.112955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b4b3a-01d0-4691-9a76-7d63376dda30 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:41.119277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e829e9-51b6-483a-b1da-efd5a215fd75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:41.119917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e829e9-51b6-483a-b1da-efd5a215fd75 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:41.120193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e829e9-51b6-483a-b1da-efd5a215fd75 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:41.120458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e829e9-51b6-483a-b1da-efd5a215fd75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:41.129086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e829e9-51b6-483a-b1da-efd5a215fd75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:41.130733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e829e9-51b6-483a-b1da-efd5a215fd75 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:41.140664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 750/1494] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:43.505397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e389c-3223-46c5-a8db-64bd105d3367 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:43.506001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e389c-3223-46c5-a8db-64bd105d3367 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:43.506001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e389c-3223-46c5-a8db-64bd105d3367 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:43.507733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 745/1495] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:43.514219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d229269-0135-4d0f-b906-2e521987f72f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:43.514976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d229269-0135-4d0f-b906-2e521987f72f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:43.515101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d229269-0135-4d0f-b906-2e521987f72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:43.535523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7d229269-0135-4d0f-b906-2e521987f72f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:43.536749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7d229269-0135-4d0f-b906-2e521987f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:43.546519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 751/1496] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:43.601425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e389c-3223-46c5-a8db-64bd105d3367 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:43.618548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e389c-3223-46c5-a8db-64bd105d3367 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:43.622700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486cd8e-3740-4299-b0b4-4a1a5c03b895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:43.623345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486cd8e-3740-4299-b0b4-4a1a5c03b895 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:43.623626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486cd8e-3740-4299-b0b4-4a1a5c03b895 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:43.623900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486cd8e-3740-4299-b0b4-4a1a5c03b895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:43.632812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486cd8e-3740-4299-b0b4-4a1a5c03b895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:43.634241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486cd8e-3740-4299-b0b4-4a1a5c03b895 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:43.643884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 746/1497] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:45.885093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3cb4-26a6-4ac9-8b0a-c1a504fc561f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:45.885686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3cb4-26a6-4ac9-8b0a-c1a504fc561f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:45.885686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3cb4-26a6-4ac9-8b0a-c1a504fc561f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:45.887551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 752/1498] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:45.893832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6bea-0e83-4aa5-a289-f80102e8afe0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:45.894266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6bea-0e83-4aa5-a289-f80102e8afe0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:45.894359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6bea-0e83-4aa5-a289-f80102e8afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:45.915640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c7aa6bea-0e83-4aa5-a289-f80102e8afe0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:45.916866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c7aa6bea-0e83-4aa5-a289-f80102e8afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:45.926260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 747/1499] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:45.967399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3cb4-26a6-4ac9-8b0a-c1a504fc561f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:45.986788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3cb4-26a6-4ac9-8b0a-c1a504fc561f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:45.991434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dee9ec-d8ea-42c5-b9c7-7c335a997ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:45.992062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dee9ec-d8ea-42c5-b9c7-7c335a997ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:45.992336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dee9ec-d8ea-42c5-b9c7-7c335a997ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:45.992604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dee9ec-d8ea-42c5-b9c7-7c335a997ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:46.001842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dee9ec-d8ea-42c5-b9c7-7c335a997ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:46.003353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dee9ec-d8ea-42c5-b9c7-7c335a997ed1 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:46.012750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 753/1500] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:48.338651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9e35-4066-438b-bafd-c95d68d07ce1 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:48.339261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9e35-4066-438b-bafd-c95d68d07ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:48.339261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9e35-4066-438b-bafd-c95d68d07ce1 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:48.341035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 748/1501] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:48.347357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:48.347801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:48.347921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:48.368119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:48.369335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:48.379384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 754/1502] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:48.424381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9e35-4066-438b-bafd-c95d68d07ce1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:48.437802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9e35-4066-438b-bafd-c95d68d07ce1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:48.443089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585da2e-d869-47e0-b03c-b5c42b395498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:48.443931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585da2e-d869-47e0-b03c-b5c42b395498 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:48.444210 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585da2e-d869-47e0-b03c-b5c42b395498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:48.444483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585da2e-d869-47e0-b03c-b5c42b395498 admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:48.445738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585da2e-d869-47e0-b03c-b5c42b395498 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:48.447527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585da2e-d869-47e0-b03c-b5c42b395498 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:48.449202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 749/1503] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:51:48 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:51:48.461427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:48.474990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa8654-8fb0-4b65-9bcf-0a3a63032211 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:48.479840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c94d6-ea08-4672-9ba2-207da4417ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:48.480480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c94d6-ea08-4672-9ba2-207da4417ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:48.480742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c94d6-ea08-4672-9ba2-207da4417ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:48.481048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c94d6-ea08-4672-9ba2-207da4417ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:48.490678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c94d6-ea08-4672-9ba2-207da4417ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:48.492104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c94d6-ea08-4672-9ba2-207da4417ff9 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:48.501847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 755/1504] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:51:50.858321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e56ff-4753-47f3-9600-b50c3597b2a6 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:50.859162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e56ff-4753-47f3-9600-b50c3597b2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:50.859162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e56ff-4753-47f3-9600-b50c3597b2a6 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:50.861958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 750/1505] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 3 02:51:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:51:50.870921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:50.871369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:50.871465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:50.892587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:51:50.893861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:51:50.902243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 756/1506] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 3 02:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:51:50.935998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e56ff-4753-47f3-9600-b50c3597b2a6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:50.956832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e56ff-4753-47f3-9600-b50c3597b2a6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:50.962055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0667b1-070a-4988-b7bd-b09886bc8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:50.962899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0667b1-070a-4988-b7bd-b09886bc8124 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:50.963184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0667b1-070a-4988-b7bd-b09886bc8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:50.963461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0667b1-070a-4988-b7bd-b09886bc8124 admin admin] PATH_INFO: `/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:50.964758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0667b1-070a-4988-b7bd-b09886bc8124 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d8bb283e83f49d4ae1d0a1e9323f94b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:50.966576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0667b1-070a-4988-b7bd-b09886bc8124 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:50.968226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 751/1507] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 3 02:51:50 2022] GET /identity/v3/projects/1d8bb283e83f49d4ae1d0a1e9323f94b => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:51:50.979719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:51:50.989527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64494-1c31-429a-b064-f03ad6db5e7f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:51:50.993709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f116-d26e-453e-8535-060e3e64521a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:51:50.994355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f116-d26e-453e-8535-060e3e64521a service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:51:50.994631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f116-d26e-453e-8535-060e3e64521a service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:51:50.994897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f116-d26e-453e-8535-060e3e64521a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:51:51.004997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f116-d26e-453e-8535-060e3e64521a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:51:51.006441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f116-d26e-453e-8535-060e3e64521a service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:51:51.016227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 757/1508] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:53:06.118976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.119476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.119476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.139430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:53:06.140594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:53:06.149400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 752/1509] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:53:06.158025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.158507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.158616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.179065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:53:06.180221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:53:06.188472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 758/1510] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:53:06.192997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.202474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ff37c-ae03-424d-b8bf-33b09ef2690d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.207617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.208251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.208519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.208798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.209546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:53:06.209838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.211434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.222785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 753/1511] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:53:06.231102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.241363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad3d8a-0b70-4970-a9f7-b724d134dd9d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.246706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.247337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.247614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.247882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.248581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.250508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.290368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 759/1512] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:53:06 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:53:06.294713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.304441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0ac70-6315-4cf5-9abf-287c995986b4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.363867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.364810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.365228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.365594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.366484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.369586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.395239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 754/1513] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:53:06 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:53:06.399576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.409732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733611f8-1ff8-4fad-99a4-ca9ff2b94a40 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.414335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.414981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.415254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.415520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.416243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.417874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.430342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 760/1514] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:53:06.434217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.444109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be4fe-6010-4aa4-aa93-f4f8934b684c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.448750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11e7ef-71a2-4378-9549-d4c5fcfbe963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.449412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e7ef-71a2-4378-9549-d4c5fcfbe963 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.449684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e7ef-71a2-4378-9549-d4c5fcfbe963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.449944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e7ef-71a2-4378-9549-d4c5fcfbe963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.450692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11e7ef-71a2-4378-9549-d4c5fcfbe963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.452272 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11e7ef-71a2-4378-9549-d4c5fcfbe963 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.465235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 755/1515] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:53:06.469173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.478745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32f6d-7667-4524-8746-eb21af509283 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.484220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.485117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.485421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.485682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] PATH_INFO: `/v3/projects/db09ac3daec84e90b583d79303dfd67e/users/c50d60dc7d4f4ac4b974ac73dc477c1b/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.500493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=db09ac3daec84e90b583d79303dfd67e, user_id=c50d60dc7d4f4ac4b974ac73dc477c1b, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.503159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.519278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 761/1516] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:53:06 2022] PUT /identity/v3/projects/db09ac3daec84e90b583d79303dfd67e/users/c50d60dc7d4f4ac4b974ac73dc477c1b/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:53:06.532397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e1cb-3076-4cc8-8d42-4ef043b968d8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.532852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e1cb-3076-4cc8-8d42-4ef043b968d8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.533249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e1cb-3076-4cc8-8d42-4ef043b968d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.562017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f7c9e1cb-3076-4cc8-8d42-4ef043b968d8 None None] MFA Rules not processed for user `c50d60dc7d4f4ac4b974ac73dc477c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:53:06.563441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f7c9e1cb-3076-4cc8-8d42-4ef043b968d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:53:06.634049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 756/1517] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:53:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:53:06.647182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.726720 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df0fd-8540-458f-ba7c-035aecb3f1ba admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.732988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.733641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.733914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.734229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.742697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.744378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.753876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 762/1518] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:53:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:53:06.824372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d641-1480-4224-a16e-166354407e50 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.824744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d641-1480-4224-a16e-166354407e50 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.825030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d641-1480-4224-a16e-166354407e50 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.826729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 757/1519] 10.222.0.31 () {52 vars in 829 bytes} [Thu Feb 3 02:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:53:06.830439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:06.895570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a3f77-c6b0-4e0f-bcb4-a280b863c146 service nova] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:06.900654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:06.901546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:06.901821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:06.902105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] PATH_INFO: `/v3/users/c50d60dc7d4f4ac4b974ac73dc477c1b` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:06.903340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50d60dc7d4f4ac4b974ac73dc477c1b)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:06.904383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:53:06.904383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:53:06.904383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:53:06.905619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:06.974778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50d60dc7d4f4ac4b974ac73dc477c1b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:06.975555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50d60dc7d4f4ac4b974ac73dc477c1b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:06.987859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50d60dc7d4f4ac4b974ac73dc477c1b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.007853 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50d60dc7d4f4ac4b974ac73dc477c1b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.020369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50d60dc7d4f4ac4b974ac73dc477c1b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.030525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 763/1520] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:53:06 2022] DELETE /identity/v3/users/c50d60dc7d4f4ac4b974ac73dc477c1b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:53:07.035205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:07.035508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:07.035771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:07.053141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:53:07.054309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:53:07.112352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 758/1521] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:53:07.122977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:07.124571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:53:07.182738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddd22-1b02-4f83-8718-7f777e6f2b88 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:07.186848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1ce18-0a5a-45aa-8665-3377be125ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:07.187476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1ce18-0a5a-45aa-8665-3377be125ddd service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:07.187748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1ce18-0a5a-45aa-8665-3377be125ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:07.188043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1ce18-0a5a-45aa-8665-3377be125ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:07.197662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1ce18-0a5a-45aa-8665-3377be125ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:07.199146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1ce18-0a5a-45aa-8665-3377be125ddd service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:07.208739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 764/1522] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:53:07.575365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:53:07.577537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:53:07.591424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12fa88-a137-45e7-9d7f-8394452b60ef None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:53:07.597933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:53:07.598859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:53:07.599047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:53:07.599294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] PATH_INFO: `/v3/projects/db09ac3daec84e90b583d79303dfd67e` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:53:07.601014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db09ac3daec84e90b583d79303dfd67e)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:53:07.602424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:53:07.602424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:53:07.602424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:53:07.603619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:53:07.669352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db09ac3daec84e90b583d79303dfd67e', 'request_id': 'req-48e3bd17-6818-481b-b37d-2d2b9003a031'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.679616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db09ac3daec84e90b583d79303dfd67e', 'request_id': 'req-48e3bd17-6818-481b-b37d-2d2b9003a031'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.693283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db09ac3daec84e90b583d79303dfd67e', 'request_id': 'req-48e3bd17-6818-481b-b37d-2d2b9003a031'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.703941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] The token cache is being invalidate because project db09ac3daec84e90b583d79303dfd67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:53:07.704167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.704907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-48e3bd17-6818-481b-b37d-2d2b9003a031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:53:07.706550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 759/1523] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:53:07 2022] DELETE /identity/v3/projects/db09ac3daec84e90b583d79303dfd67e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:54:38.094482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c1543-74d7-44c6-9366-ee599cbaf623 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:38.094944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c1543-74d7-44c6-9366-ee599cbaf623 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:38.095077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c1543-74d7-44c6-9366-ee599cbaf623 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:38.096851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 765/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:38.101729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0f252-41f8-49f6-8aab-d82cb58c53a4 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:38.102191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0f252-41f8-49f6-8aab-d82cb58c53a4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:38.102304 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0f252-41f8-49f6-8aab-d82cb58c53a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:38.121759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-15e0f252-41f8-49f6-8aab-d82cb58c53a4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:38.122957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-15e0f252-41f8-49f6-8aab-d82cb58c53a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:38.185098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 760/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:38.343441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c1543-74d7-44c6-9366-ee599cbaf623 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:38.346889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c21c1543-74d7-44c6-9366-ee599cbaf623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:38.440925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c1543-74d7-44c6-9366-ee599cbaf623 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:38.447531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438f86d-6c53-4e67-b9ae-36f684ae8036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:38.448163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438f86d-6c53-4e67-b9ae-36f684ae8036 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:38.448440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438f86d-6c53-4e67-b9ae-36f684ae8036 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:38.448711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438f86d-6c53-4e67-b9ae-36f684ae8036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:38.457061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438f86d-6c53-4e67-b9ae-36f684ae8036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:54:38.458646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438f86d-6c53-4e67-b9ae-36f684ae8036 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:54:38.467983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 766/1526] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:54:38.567410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244a51e-a8f7-442f-9918-156060811e46 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:38.567689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244a51e-a8f7-442f-9918-156060811e46 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:38.567950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244a51e-a8f7-442f-9918-156060811e46 None None] PATH_INFO: `/v3` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:38.569327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 761/1527] 10.222.0.43 () {54 vars in 925 bytes} [Thu Feb 3 02:54:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:54:38.576414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df8079-7c00-49ef-9be7-4de862c65c5e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:38.576818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df8079-7c00-49ef-9be7-4de862c65c5e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:38.577157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df8079-7c00-49ef-9be7-4de862c65c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:38.597553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d8df8079-7c00-49ef-9be7-4de862c65c5e None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:38.598721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d8df8079-7c00-49ef-9be7-4de862c65c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:38.665828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 767/1528] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Feb 3 02:54:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:39.737742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067cc63-1219-4e47-a6b9-9468b287ec92 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:39.738315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067cc63-1219-4e47-a6b9-9468b287ec92 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:39.738315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067cc63-1219-4e47-a6b9-9468b287ec92 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:39.740064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 762/1529] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:39.745017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcc0f-8b08-4190-a475-c5147f58616c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:39.745468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcc0f-8b08-4190-a475-c5147f58616c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:39.745569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcc0f-8b08-4190-a475-c5147f58616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:39.766868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-66bfcc0f-8b08-4190-a475-c5147f58616c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:39.768510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-66bfcc0f-8b08-4190-a475-c5147f58616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:39.777978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 768/1530] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:39.940339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067cc63-1219-4e47-a6b9-9468b287ec92 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:39.957746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067cc63-1219-4e47-a6b9-9468b287ec92 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:39.964596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546924-88c7-4a6e-87a2-e81e762abc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:39.965282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546924-88c7-4a6e-87a2-e81e762abc3f service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:39.965543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546924-88c7-4a6e-87a2-e81e762abc3f service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:39.965814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546924-88c7-4a6e-87a2-e81e762abc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:39.974219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546924-88c7-4a6e-87a2-e81e762abc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:54:39.975809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546924-88c7-4a6e-87a2-e81e762abc3f service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:54:39.985534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 763/1531] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:54:42.493385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb33e-d7b3-483b-9865-93bad34ff479 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:42.494021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb33e-d7b3-483b-9865-93bad34ff479 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:42.494021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb33e-d7b3-483b-9865-93bad34ff479 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:42.496006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 769/1532] 10.222.0.31 () {54 vars in 960 bytes} [Thu Feb 3 02:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:42.507139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadceb4-f349-4bc2-8086-032a798e042e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:42.507965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadceb4-f349-4bc2-8086-032a798e042e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:42.508105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadceb4-f349-4bc2-8086-032a798e042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:42.527636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ccadceb4-f349-4bc2-8086-032a798e042e None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:42.528868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ccadceb4-f349-4bc2-8086-032a798e042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:42.537761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 764/1533] 10.222.0.31 () {58 vars in 1057 bytes} [Thu Feb 3 02:54:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:42.545826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cb33e-d7b3-483b-9865-93bad34ff479 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:42.560580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cb33e-d7b3-483b-9865-93bad34ff479 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:42.566047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3729f-1f3e-4c49-adbd-800057f62adb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:42.566671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3729f-1f3e-4c49-adbd-800057f62adb service placement] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:42.566946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3729f-1f3e-4c49-adbd-800057f62adb service placement] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:42.567271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3729f-1f3e-4c49-adbd-800057f62adb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:42.576128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3729f-1f3e-4c49-adbd-800057f62adb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:54:42.577870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3729f-1f3e-4c49-adbd-800057f62adb service placement] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:54:42.588522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 770/1534] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:54:51.677659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67dee-df12-48e3-a6c8-2b336560a322 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:51.678271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67dee-df12-48e3-a6c8-2b336560a322 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:51.678271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67dee-df12-48e3-a6c8-2b336560a322 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:51.680035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 765/1535] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:51.686114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33877a-adee-41b8-9142-dcc9e06e2f0b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:51.686812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33877a-adee-41b8-9142-dcc9e06e2f0b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:51.687045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33877a-adee-41b8-9142-dcc9e06e2f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:51.711153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1e33877a-adee-41b8-9142-dcc9e06e2f0b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:51.712342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1e33877a-adee-41b8-9142-dcc9e06e2f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:51.721252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 771/1536] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:51.877888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67dee-df12-48e3-a6c8-2b336560a322 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:51.902769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67dee-df12-48e3-a6c8-2b336560a322 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:51.909798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71de25-ff56-4618-bbe0-5a34110e8b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:51.910431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71de25-ff56-4618-bbe0-5a34110e8b71 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:51.910707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71de25-ff56-4618-bbe0-5a34110e8b71 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:51.910975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71de25-ff56-4618-bbe0-5a34110e8b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:51.919729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71de25-ff56-4618-bbe0-5a34110e8b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:54:51.921365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71de25-ff56-4618-bbe0-5a34110e8b71 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:54:51.931604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 766/1537] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:54:53.200456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe4299-7bed-474c-876f-9e6c2b717b44 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:53.201384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe4299-7bed-474c-876f-9e6c2b717b44 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:53.201384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe4299-7bed-474c-876f-9e6c2b717b44 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:53.203359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 772/1538] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 3 02:54:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:53.208349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0718-b381-40ae-91b9-50b8fd66f2a3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:53.208816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0718-b381-40ae-91b9-50b8fd66f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:53.208931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0718-b381-40ae-91b9-50b8fd66f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:53.227525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-428d0718-b381-40ae-91b9-50b8fd66f2a3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:53.228747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-428d0718-b381-40ae-91b9-50b8fd66f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:53.237942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 767/1539] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 3 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:53.394547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe4299-7bed-474c-876f-9e6c2b717b44 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:53.415431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe4299-7bed-474c-876f-9e6c2b717b44 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:53.421227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913754b-db7e-4988-88c7-8b778c35d1a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:53.421864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913754b-db7e-4988-88c7-8b778c35d1a1 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:53.422164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913754b-db7e-4988-88c7-8b778c35d1a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:53.422433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913754b-db7e-4988-88c7-8b778c35d1a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:53.430984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913754b-db7e-4988-88c7-8b778c35d1a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:54:53.432603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913754b-db7e-4988-88c7-8b778c35d1a1 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:54:53.442214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 773/1540] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:54:57.550556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcccef3-7583-432e-a1b2-9e2903a35cda None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:57.551131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcccef3-7583-432e-a1b2-9e2903a35cda None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:57.551131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcccef3-7583-432e-a1b2-9e2903a35cda None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:57.552937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 768/1541] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:57.559256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e082a-8777-4209-8090-ed7d326612ac None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:57.559987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e082a-8777-4209-8090-ed7d326612ac None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:57.560132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e082a-8777-4209-8090-ed7d326612ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:57.586422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d10e082a-8777-4209-8090-ed7d326612ac None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:57.587625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d10e082a-8777-4209-8090-ed7d326612ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:57.596569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 774/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:57.633121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcccef3-7583-432e-a1b2-9e2903a35cda None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:57.634945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3fcccef3-7583-432e-a1b2-9e2903a35cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:57.692226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcccef3-7583-432e-a1b2-9e2903a35cda None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:57.697060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0190f8-8e4a-4b0f-81dc-7acb9870a600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:57.697703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0190f8-8e4a-4b0f-81dc-7acb9870a600 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:57.697979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0190f8-8e4a-4b0f-81dc-7acb9870a600 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:57.698239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0190f8-8e4a-4b0f-81dc-7acb9870a600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:57.708016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0190f8-8e4a-4b0f-81dc-7acb9870a600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:54:57.709493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0190f8-8e4a-4b0f-81dc-7acb9870a600 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:54:57.719404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 769/1543] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:54:59.890237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1276-285e-43fb-b884-09daac4065f7 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:59.890841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1276-285e-43fb-b884-09daac4065f7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:59.890841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1276-285e-43fb-b884-09daac4065f7 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:59.892586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 775/1544] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:54:59.899229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4aaec-1e03-4e6d-b661-a7f5c7f19cba None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:59.899900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4aaec-1e03-4e6d-b661-a7f5c7f19cba None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:59.900058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4aaec-1e03-4e6d-b661-a7f5c7f19cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:54:59.927553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-95d4aaec-1e03-4e6d-b661-a7f5c7f19cba None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:54:59.928748 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-95d4aaec-1e03-4e6d-b661-a7f5c7f19cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:59.937818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 770/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:54:59.974680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1276-285e-43fb-b884-09daac4065f7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:54:59.976768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d27d1276-285e-43fb-b884-09daac4065f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:54:59.992618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1276-285e-43fb-b884-09daac4065f7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:54:59.996467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e4721-e170-4993-a087-90c924307887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:54:59.997135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e4721-e170-4993-a087-90c924307887 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:54:59.997412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e4721-e170-4993-a087-90c924307887 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:54:59.997681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e4721-e170-4993-a087-90c924307887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:00.007908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e4721-e170-4993-a087-90c924307887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:55:00.009432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e4721-e170-4993-a087-90c924307887 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:55:00.019238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 776/1546] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:55:03.654423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633720e6-3572-47f9-930b-cc9b4c437e85 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:03.655021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633720e6-3572-47f9-930b-cc9b4c437e85 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:03.655021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633720e6-3572-47f9-930b-cc9b4c437e85 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:03.656873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 771/1547] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:55:03.662268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a0a0b-e670-4dba-a8cf-060b96432d2c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:03.662725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a0a0b-e670-4dba-a8cf-060b96432d2c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:03.662828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a0a0b-e670-4dba-a8cf-060b96432d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:03.681433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8c5a0a0b-e670-4dba-a8cf-060b96432d2c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:55:03.682635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8c5a0a0b-e670-4dba-a8cf-060b96432d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:55:03.691246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 777/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:55:03.945099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633720e6-3572-47f9-930b-cc9b4c437e85 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:55:03.948209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-633720e6-3572-47f9-930b-cc9b4c437e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:55:04.015664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633720e6-3572-47f9-930b-cc9b4c437e85 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:55:04.019915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a934b3-1ef8-4e1a-aa97-c311c025514f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:55:04.020562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a934b3-1ef8-4e1a-aa97-c311c025514f service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:04.020873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a934b3-1ef8-4e1a-aa97-c311c025514f service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:04.021144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a934b3-1ef8-4e1a-aa97-c311c025514f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:04.030735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a934b3-1ef8-4e1a-aa97-c311c025514f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:55:04.032160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a934b3-1ef8-4e1a-aa97-c311c025514f service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:55:04.041463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 772/1549] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:55:06.283460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686a98-6c1b-4c43-972e-547babfa87d1 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:06.284050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686a98-6c1b-4c43-972e-547babfa87d1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:06.284050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686a98-6c1b-4c43-972e-547babfa87d1 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:06.285886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 778/1550] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 3 02:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:55:06.292449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399970-f1ea-4ccc-a3bb-497078fd27a4 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:06.293267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399970-f1ea-4ccc-a3bb-497078fd27a4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:06.293441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399970-f1ea-4ccc-a3bb-497078fd27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:06.318572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ee399970-f1ea-4ccc-a3bb-497078fd27a4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:55:06.319752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ee399970-f1ea-4ccc-a3bb-497078fd27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:55:06.328458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 773/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 3 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:55:06.580218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe13a5-989e-4eff-8ef0-bc8f853a6297 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:06.580466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe13a5-989e-4eff-8ef0-bc8f853a6297 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:06.580892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe13a5-989e-4eff-8ef0-bc8f853a6297 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:06.582698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 779/1552] 10.222.0.31 () {54 vars in 963 bytes} [Thu Feb 3 02:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:55:06.588691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51974d44-7cc0-46bc-b85a-af87d9d5a494 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:06.589113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51974d44-7cc0-46bc-b85a-af87d9d5a494 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:06.589445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51974d44-7cc0-46bc-b85a-af87d9d5a494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:06.614757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-51974d44-7cc0-46bc-b85a-af87d9d5a494 None None] MFA Rules not processed for user `30865d753bcb4542bee3b1c86a14b51e`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:55:06.615948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-51974d44-7cc0-46bc-b85a-af87d9d5a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:55:06.623041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 774/1553] 10.222.0.31 () {58 vars in 1060 bytes} [Thu Feb 3 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:55:06.630559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe13a5-989e-4eff-8ef0-bc8f853a6297 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:55:06.643882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe13a5-989e-4eff-8ef0-bc8f853a6297 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:55:06.650449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba36dc-009a-4c33-8dd1-8d73dbdedfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:55:06.651369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba36dc-009a-4c33-8dd1-8d73dbdedfde service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:55:06.651739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba36dc-009a-4c33-8dd1-8d73dbdedfde service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:55:06.651980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba36dc-009a-4c33-8dd1-8d73dbdedfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:55:06.668285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba36dc-009a-4c33-8dd1-8d73dbdedfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:55:06.670541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba36dc-009a-4c33-8dd1-8d73dbdedfde service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:55:06.680502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 780/1554] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:28.320010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c9ce-df6e-4317-8521-eb1ccfdb3257 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.321247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c9ce-df6e-4317-8521-eb1ccfdb3257 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.321779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c9ce-df6e-4317-8521-eb1ccfdb3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.328814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16cb9-6eec-4afe-85f5-964b1ef337a7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.329371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16cb9-6eec-4afe-85f5-964b1ef337a7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.329371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16cb9-6eec-4afe-85f5-964b1ef337a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.344131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4c09c9ce-df6e-4317-8521-eb1ccfdb3257 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.345725 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4c09c9ce-df6e-4317-8521-eb1ccfdb3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.365534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-46f16cb9-6eec-4afe-85f5-964b1ef337a7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.366641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 775/1555] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.366771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-46f16cb9-6eec-4afe-85f5-964b1ef337a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.368431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969abe-ca39-401e-adad-0ba86a7a33d1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.368951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969abe-ca39-401e-adad-0ba86a7a33d1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.369573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969abe-ca39-401e-adad-0ba86a7a33d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.378784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 781/1556] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.387093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b388f-386c-4be1-bcf8-3f620bbe88dc None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.387417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b388f-386c-4be1-bcf8-3f620bbe88dc None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.387691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b388f-386c-4be1-bcf8-3f620bbe88dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.403309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f5969abe-ca39-401e-adad-0ba86a7a33d1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.404952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f5969abe-ca39-401e-adad-0ba86a7a33d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.418409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-a68b388f-386c-4be1-bcf8-3f620bbe88dc None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.419680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a68b388f-386c-4be1-bcf8-3f620bbe88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.421808 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 776/1557] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.423460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.424020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.424483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.436821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 782/1558] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:28.444521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e69c6-0535-4f46-b77b-0ca381019275 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.444740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e69c6-0535-4f46-b77b-0ca381019275 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.444997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e69c6-0535-4f46-b77b-0ca381019275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.456307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.457892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.473394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2e3e69c6-0535-4f46-b77b-0ca381019275 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.474665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2e3e69c6-0535-4f46-b77b-0ca381019275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.475388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 777/1559] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.476423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.488886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 783/1560] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.490253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445df6-8f47-44e4-b0a3-5c34f555e43f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.490538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445df6-8f47-44e4-b0a3-5c34f555e43f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.490811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445df6-8f47-44e4-b0a3-5c34f555e43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.491273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14e02e-fc8b-4f6f-aaf9-5003ce91ddaf None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.496990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.497950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.498428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.498886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.499815 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.500305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.506494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562587e-677e-4ec7-ba53-c723537e3082 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.509910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-df445df6-8f47-44e4-b0a3-5c34f555e43f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.511124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-df445df6-8f47-44e4-b0a3-5c34f555e43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.519450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 784/1561] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.519614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 778/1562] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:28.521375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.521521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.521605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.521694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.521782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.521863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.542848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.543061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.544036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.544147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.552114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 785/1563] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.552265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 779/1564] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.552671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.557008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.566105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ef98-0708-4922-9b26-ea41d4804797 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.566871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b92b7-91ff-419a-87a4-9f21d4c65966 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.570678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.571242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.571368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.571583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.571852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.571957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.572256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.572528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.572630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.572913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.573302 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.573601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.574503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776a63-889c-4060-b1f5-fb1cc715ef8c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.575181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0efd8-2769-40de-828f-c0f01074ab0b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.586602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 786/1565] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:28.587004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 780/1566] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:28.587837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7dfb-8f4b-42f6-adf4-25cdec8ed237 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.588088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7dfb-8f4b-42f6-adf4-25cdec8ed237 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.588341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.588460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7dfb-8f4b-42f6-adf4-25cdec8ed237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.588626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.588933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.607147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c7ea7dfb-8f4b-42f6-adf4-25cdec8ed237 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.608260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7ea7dfb-8f4b-42f6-adf4-25cdec8ed237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.608708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.609968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.616613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 787/1567] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.617764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a13db-3d05-421b-98ec-c2c769c79aac None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.618042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a13db-3d05-421b-98ec-c2c769c79aac None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.618267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a13db-3d05-421b-98ec-c2c769c79aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.619260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 781/1568] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.619876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.630246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62366c-d61f-4fa8-a812-d65f3b100ffa None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.635200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8497f6-1cf3-49a1-b7f7-f43871e9a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.635867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8497f6-1cf3-49a1-b7f7-f43871e9a137 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.636142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8497f6-1cf3-49a1-b7f7-f43871e9a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.636438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8497f6-1cf3-49a1-b7f7-f43871e9a137 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.637253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8497f6-1cf3-49a1-b7f7-f43871e9a137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.639225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8497f6-1cf3-49a1-b7f7-f43871e9a137 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.642984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d90a13db-3d05-421b-98ec-c2c769c79aac None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.644150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d90a13db-3d05-421b-98ec-c2c769c79aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.651933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 788/1569] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.653200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.653485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.653762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.666244 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 782/1570] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:28.667541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.667827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.668099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.672443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.673645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.685275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.686452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.728879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 789/1571] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.730059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.739137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec120d5-da69-4a8a-9bb0-67f34fdcab19 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.743539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce8753-dc33-495e-854c-f7a98d382975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.744168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce8753-dc33-495e-854c-f7a98d382975 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.744439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce8753-dc33-495e-854c-f7a98d382975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.744704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce8753-dc33-495e-854c-f7a98d382975 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.745405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce8753-dc33-495e-854c-f7a98d382975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.747110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 783/1572] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.747316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce8753-dc33-495e-854c-f7a98d382975 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.747921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.757195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239237c5-e9e3-4cf2-94d2-f3eb7fd953ec None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.761787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a985a-ff2e-4978-b59e-a49a5cfa4809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.762426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a985a-ff2e-4978-b59e-a49a5cfa4809 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.762700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a985a-ff2e-4978-b59e-a49a5cfa4809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.763021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a985a-ff2e-4978-b59e-a49a5cfa4809 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.764465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a985a-ff2e-4978-b59e-a49a5cfa4809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.766057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a985a-ff2e-4978-b59e-a49a5cfa4809 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.773592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 790/1573] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:28.774957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.775246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.775520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.795944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 784/1574] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:28.796163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.796252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.796252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.796252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.796485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.813925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:28.815254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:28.853188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 791/1575] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.854581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.864079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf917e-e4a3-443f-814d-3809f3bbb5d0 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.868642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.869311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.869596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.869868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.870635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.870938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.871939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 785/1576] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:28.872597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.872783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.881523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ebc92-e836-4182-a48f-ddb811a72347 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.885222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 792/1577] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:28.885998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.893569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.894275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.894552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.894824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.895488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826d2f-69e4-4bd1-a9ff-939a112da861 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.895589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.897515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.900442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.901102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.901404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.901672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.902383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.902679 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.904241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.916707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 793/1578] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:28.917619 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.918134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 786/1579] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:28.921913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.931841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1b51-cd53-4cb8-baa9-a5086229776e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.935793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8bba-5b1c-4216-b6f5-036e233da323 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.936512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.937215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.937499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.937775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.938489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.940474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.940597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.941196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.941476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.941849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.942579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.942930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.944609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.956384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 794/1580] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:28.957402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.966667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729e19-f6b6-4f85-8825-000a73e0fedc admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.969652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 787/1581] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:28.970459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:28.971351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.971999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.972275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.972542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.973274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.975183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.980071 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b84b4-0aa1-4f13-9f11-7b9c7f357311 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:28.984613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:28.985289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:28.985560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:28.985842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:28.986630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:28.986931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:28.988514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:28.995419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 795/1582] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:28 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:28.996245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.003974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 788/1583] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:29.004759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.005296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d5a6-469f-4f31-90e3-3a50bd5b57ed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.012079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.012742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.013197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.013474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.014213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:29.014633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.016313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.017795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa6939-1507-42c7-8108-05be2dd40cd6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.022653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.023296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.023569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.023834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.024535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.026528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.029366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 796/1584] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:29.030133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.039189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810ed1-5544-43d0-b3a9-e42c99f33d97 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.043813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.044551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.044671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.045071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.045845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.047641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.057897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 797/1585] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.058713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.064112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 789/1586] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.064112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.071156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359a3d5-0b7a-461f-9860-c6cb24e881f1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.126680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f75fd-11f6-47cb-88c5-6eca82ad6915 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.130701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.131368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.131513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.131641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.131905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.132060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.132333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.132602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.132707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.133340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.134684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.135226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.160851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 798/1587] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.161946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.162759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 790/1588] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.163696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.221122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843536-0063-4e2f-b2cb-06281ec78791 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.223352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0504-d02c-4212-9abc-12365eb3dc1e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.225702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.226362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.226645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.226918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.227647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.228520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.229587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.229712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.229871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.230139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.230877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.232481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.239389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 799/1589] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.240153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.243112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 791/1590] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.244154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.250906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca87501-532f-4f7b-9d2c-b1bcfbb63d60 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.253982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531004a2-4993-48ce-a17f-e28ae711cbec admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.256161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.256850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.257155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.257570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.258275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.258533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.259151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.259425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.259692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.260211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.260379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.262285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.287926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 800/1591] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.288774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.289240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 792/1592] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.290118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.350406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189c8e9-93a4-4a83-b288-dbc80ec56cf7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.354589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf0ce5-cb6a-4b85-a58b-f6ee37c23fa8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.355812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.356507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.356789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.357105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.357840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.359177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.359524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.359810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.360085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.360353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.361192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.363262 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.369627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 801/1593] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.370656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.383091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c411ca2-e49d-4a75-804a-2f538eda8998 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.386541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 793/1594] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.387346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.390426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.391107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.391419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.391718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.392434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.394420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.398873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246b97d-f048-41c8-bac3-30fc3c23fb1d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.403731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.404301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.404606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.404935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.405638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.408417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.415234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 802/1595] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.415920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.425514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd2ec7-468a-4558-aa22-397aad96de02 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.432335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 794/1596] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.432335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.433264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.433913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.434194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.434464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.435198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.436827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.441868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4dc76-7d9f-4e32-b4c4-212135757e61 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.446861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 803/1597] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.447068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.447702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.448289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.448577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.448900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.449655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.451296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.459636 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542474f-de65-4626-8c71-8c85a3637c9d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.461557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 795/1598] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.462332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.465350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.466010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.466298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.466562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.467286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.469245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.473761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8572-29c6-4e95-944e-2a0556b42cab admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.478519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.479165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.479836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.480110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.480906 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.482915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.493314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 804/1599] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.494172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.503678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff99d-1be4-48b4-847f-adcc5f357cc8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.504471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 796/1600] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:29.505184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.510566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.511440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.511715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.511983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] PATH_INFO: `/v3/projects/a2f534df59e149f8b14cd7406f932b2d/users/3b69c633ad9a496f924f8f2479eea06d/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.514343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920406d-5d44-4712-87d0-8dd849a04b4b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.518806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.519439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.519717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.519986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.520730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.522330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.526239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f534df59e149f8b14cd7406f932b2d, user_id=3b69c633ad9a496f924f8f2479eea06d, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.528958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.531986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 797/1601] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.532790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.541996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a10a8-d032-46b2-9426-52be6aae8158 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.548600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 805/1602] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:29 2022] PUT /identity/v3/projects/a2f534df59e149f8b14cd7406f932b2d/users/3b69c633ad9a496f924f8f2479eea06d/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:29.548600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.597070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.597737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.598021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.598292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.599035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.600685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.607778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d669f06-c5b0-4f91-9639-2b552aea906b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.610554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 798/1603] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.611290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.612961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.613628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.613911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.614302 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.615048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.616693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.620423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98bcc-471a-431a-b062-f1b208911d63 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.625014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.625862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.626139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.626410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] PATH_INFO: `/v3/projects/818a964e58b641b590d96b84862e1f58/users/3e843b98d61545b1841cf07400423dd4/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.629790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 806/1604] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.629790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.637874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb9c2-9876-40fd-b41c-382f31549449 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.641048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818a964e58b641b590d96b84862e1f58, user_id=3e843b98d61545b1841cf07400423dd4, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.642393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.643352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.643612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.643783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.643895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] PATH_INFO: `/v3/projects/9cdfe1c1946840c19d3d559fb81e34b5/users/f755cdacf8054a9e916ec75f1dedc105/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.658465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 799/1605] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:29 2022] PUT /identity/v3/projects/818a964e58b641b590d96b84862e1f58/users/3e843b98d61545b1841cf07400423dd4/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:29.659040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdfe1c1946840c19d3d559fb81e34b5, user_id=f755cdacf8054a9e916ec75f1dedc105, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.659340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.661798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.681007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 807/1606] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:29 2022] PUT /identity/v3/projects/9cdfe1c1946840c19d3d559fb81e34b5/users/f755cdacf8054a9e916ec75f1dedc105/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:29.682454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.725370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c898-dcbc-45f4-94d4-d4d5c5406919 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.746239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6e6b4-e81d-4919-a420-d4ec615ffb72 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.750971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.751633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.751911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.752215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.752980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.754589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.764244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 808/1607] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.765040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.776205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca89ebc-321d-4ec9-bb98-9a7886f77838 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.779101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7449f9-bc29-458a-83e1-02cbb33ccb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.779777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7449f9-bc29-458a-83e1-02cbb33ccb38 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.780060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7449f9-bc29-458a-83e1-02cbb33ccb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.780334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7449f9-bc29-458a-83e1-02cbb33ccb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.780799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.781184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7449f9-bc29-458a-83e1-02cbb33ccb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.781378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.781657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.781927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.782642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.782831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7449f9-bc29-458a-83e1-02cbb33ccb38 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.784242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.792399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 800/1608] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.793729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.794021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.794295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.797500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 809/1609] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.797500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.807042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78726532-2c28-4204-863d-ec7760b2b1af admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.811633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:29.812404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bd0eb-5734-489d-b4f5-96293dc86d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.812861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:29.813078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bd0eb-5734-489d-b4f5-96293dc86d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.813346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bd0eb-5734-489d-b4f5-96293dc86d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.813617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bd0eb-5734-489d-b4f5-96293dc86d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.814331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bd0eb-5734-489d-b4f5-96293dc86d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.815913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bd0eb-5734-489d-b4f5-96293dc86d0c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.820874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 801/1610] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:29.821648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.829440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 810/1611] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.830784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.830915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322ec3-ff33-41f7-a788-1fc1a233c1b2 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.831021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.831320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.837288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9175-05d6-4db0-891a-e0c78ea315b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.837988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9175-05d6-4db0-891a-e0c78ea315b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.838264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9175-05d6-4db0-891a-e0c78ea315b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.838531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9175-05d6-4db0-891a-e0c78ea315b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.839447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9175-05d6-4db0-891a-e0c78ea315b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.841150 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9175-05d6-4db0-891a-e0c78ea315b7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.851167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 802/1612] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.852382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.852609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:29.852705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.852953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.853790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:29.862129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 811/1613] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:29.865777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.875506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82e4f-dce9-450d-9a30-091b9016afca None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.880321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] MFA Rules not processed for user `3e843b98d61545b1841cf07400423dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:29.880457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.881112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.881400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.881505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:29.881662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.882393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.884007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.894312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 812/1614] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.895328 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.904309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1afb-c062-4bdc-8c3e-41405babb9aa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.908875 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.909500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.909774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.910132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.910781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.912338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.922470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 813/1615] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:29.923221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.934976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e821-7950-4135-a51d-12a4d6030c73 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.939678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.940540 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.940898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.941168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] PATH_INFO: `/v3/projects/5c189a73642b4f5ba787addbc275d4c0/users/076a8d1b26864240a8007d2ac7080e0b/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.942720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 803/1616] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:29.943541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.953848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b82b6-5297-45ce-962a-c6e716d0d60d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:29.956992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c189a73642b4f5ba787addbc275d4c0, user_id=076a8d1b26864240a8007d2ac7080e0b, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.958764 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:29.959656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:29.959763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:29.959944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:29.960219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] PATH_INFO: `/v3/projects/17f313a1b92c4e11886efd554edbb0b2/users/4b315117edec4110ba8432c5a7284300/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:29.975534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f313a1b92c4e11886efd554edbb0b2, user_id=4b315117edec4110ba8432c5a7284300, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:29.975858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 814/1617] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:29 2022] PUT /identity/v3/projects/5c189a73642b4f5ba787addbc275d4c0/users/076a8d1b26864240a8007d2ac7080e0b/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:29.976898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:29.978514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.004741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 804/1618] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:29 2022] PUT /identity/v3/projects/17f313a1b92c4e11886efd554edbb0b2/users/4b315117edec4110ba8432c5a7284300/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:30.004741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.034575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0d517-e667-41a8-be54-057e2183815d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.067677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010a6dd-2f49-4e15-8bae-ac912992ed9c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.072459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.073364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.073639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.073904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] PATH_INFO: `/v3/projects/f75fb8e584c04ce481262c99952f2b71/users/82700debf402442db1defe05c44641a4/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.089731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.090007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75fb8e584c04ce481262c99952f2b71, user_id=82700debf402442db1defe05c44641a4, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.090440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.090721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.090992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.092677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.100669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.102128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.107460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 805/1619] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:29 2022] PUT /identity/v3/projects/f75fb8e584c04ce481262c99952f2b71/users/82700debf402442db1defe05c44641a4/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:30.108240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.112223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 815/1620] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:30.113199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.126006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7042c-00ee-4dea-beb3-ba3777f68171 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.171247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763c681-1c92-4def-ae8c-7a430122f4d4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.175635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d46fe-b034-4fab-96c1-c5a803d4df0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.176642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d46fe-b034-4fab-96c1-c5a803d4df0c service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.177261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d46fe-b034-4fab-96c1-c5a803d4df0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.177680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d46fe-b034-4fab-96c1-c5a803d4df0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.199746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.200654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.200951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.201225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] PATH_INFO: `/v3/projects/ff777728bb704feeabf264e753679daa/users/087b5f4f3891413b8b7fa727768c09a4/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.216245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff777728bb704feeabf264e753679daa, user_id=087b5f4f3891413b8b7fa727768c09a4, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.219038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.232638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 816/1621] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:30 2022] PUT /identity/v3/projects/ff777728bb704feeabf264e753679daa/users/087b5f4f3891413b8b7fa727768c09a4/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:30.233458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.249790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d46fe-b034-4fab-96c1-c5a803d4df0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.251507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d46fe-b034-4fab-96c1-c5a803d4df0c service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.263147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 806/1622] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:30.264855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87640606-31ee-41c2-854e-15446a66dbcd None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.265144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87640606-31ee-41c2-854e-15446a66dbcd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.265411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87640606-31ee-41c2-854e-15446a66dbcd None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.267082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 807/1623] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 3 02:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:30.268229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddee6-e744-423f-9b52-05b4da404a66 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.268561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddee6-e744-423f-9b52-05b4da404a66 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.268866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddee6-e744-423f-9b52-05b4da404a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.286123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a67ddee6-e744-423f-9b52-05b4da404a66 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.287477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a67ddee6-e744-423f-9b52-05b4da404a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.308607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af91b6-2f4e-489f-beeb-6bb836931151 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.315572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013bb90-34e8-4499-87a9-2d4f1e46929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.315680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013bb90-34e8-4499-87a9-2d4f1e46929d admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.316170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013bb90-34e8-4499-87a9-2d4f1e46929d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.329183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013bb90-34e8-4499-87a9-2d4f1e46929d admin admin] PATH_INFO: `/v3/projects/bbecd1425b924535baf609b93b1fb771/users/c988b35edaa14743907463cf1939d854/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.346115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013bb90-34e8-4499-87a9-2d4f1e46929d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbecd1425b924535baf609b93b1fb771, user_id=c988b35edaa14743907463cf1939d854, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.348824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013bb90-34e8-4499-87a9-2d4f1e46929d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.352658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 808/1624] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.352658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d37d3-b0b7-4b35-bbf6-2e2b64ce1861 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.352658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d37d3-b0b7-4b35-bbf6-2e2b64ce1861 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.352658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d37d3-b0b7-4b35-bbf6-2e2b64ce1861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.366478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 817/1625] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:30 2022] PUT /identity/v3/projects/bbecd1425b924535baf609b93b1fb771/users/c988b35edaa14743907463cf1939d854/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:30.381479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67f687-35fb-47de-b364-c765619362f8 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.382384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67f687-35fb-47de-b364-c765619362f8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.382825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67f687-35fb-47de-b364-c765619362f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.384061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d60d37d3-b0b7-4b35-bbf6-2e2b64ce1861 None None] MFA Rules not processed for user `4b315117edec4110ba8432c5a7284300`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.385481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d60d37d3-b0b7-4b35-bbf6-2e2b64ce1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.425818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0f67f687-35fb-47de-b364-c765619362f8 None None] MFA Rules not processed for user `82700debf402442db1defe05c44641a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.427180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0f67f687-35fb-47de-b364-c765619362f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.473072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 809/1626] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.474541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.474818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.475384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.494762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.496149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.512941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 818/1627] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.514548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221170d-5491-48e7-90f1-716cd262906c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.514840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221170d-5491-48e7-90f1-716cd262906c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.515116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221170d-5491-48e7-90f1-716cd262906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.535635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d221170d-5491-48e7-90f1-716cd262906c None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.536940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d221170d-5491-48e7-90f1-716cd262906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.573694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 810/1628] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.574414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.619682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 819/1629] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.621616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.621985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.622553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.643509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bedbe1-2485-4b30-b204-1af34f6d680c None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.651728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60425c05-dece-44cb-a43a-9f6dcdd7447d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.652484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60425c05-dece-44cb-a43a-9f6dcdd7447d service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.652903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60425c05-dece-44cb-a43a-9f6dcdd7447d service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.653245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60425c05-dece-44cb-a43a-9f6dcdd7447d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.658008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] MFA Rules not processed for user `c988b35edaa14743907463cf1939d854`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.659443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.671470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60425c05-dece-44cb-a43a-9f6dcdd7447d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.672976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60425c05-dece-44cb-a43a-9f6dcdd7447d service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.686015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 811/1630] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:30.688355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd900a-2c5a-4a22-9f0f-0a4af00c2d45 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.688643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd900a-2c5a-4a22-9f0f-0a4af00c2d45 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.689568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd900a-2c5a-4a22-9f0f-0a4af00c2d45 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.699401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 812/1631] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 3 02:56:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:30.701136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd900a-2c5a-4a22-9f0f-0a4af00c2d45 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.725809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd900a-2c5a-4a22-9f0f-0a4af00c2d45 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.732810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.734086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.734364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.734680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.735393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.737489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.743975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 820/1632] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.749461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.763487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c9d98-6362-4def-8f84-2e546b70b744 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.768434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63835f-93bb-46f3-bd4c-97d2fe6a8ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.769635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63835f-93bb-46f3-bd4c-97d2fe6a8ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.769914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63835f-93bb-46f3-bd4c-97d2fe6a8ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.770190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63835f-93bb-46f3-bd4c-97d2fe6a8ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.773220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 813/1633] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:30.774217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.786498 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63835f-93bb-46f3-bd4c-97d2fe6a8ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.788750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63835f-93bb-46f3-bd4c-97d2fe6a8ff8 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:30.803526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 821/1634] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:30.805194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.805513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.805849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.831819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:30.833489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:30.882855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc97940-0b9e-4a21-90b9-d0ab74aaf46c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:30.890821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:30.892385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:30.893479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:30.893812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:30.953716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 822/1635] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:30.955944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:30.982838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:30.984959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.042822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 814/1636] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:31.063033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.089969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca4c30-494d-41b1-a346-676a39393a79 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.099517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.100770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.101436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.101913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.103390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.113612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.195191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 823/1637] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:30 2022] POST /identity/v3/projects => generated 371 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:31.197570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.225107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4239a-8da2-4625-a03d-ad85dff92267 service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.355142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf2396-dc63-4ce9-87be-5b463f1ad15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.355830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2396-dc63-4ce9-87be-5b463f1ad15c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.356107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2396-dc63-4ce9-87be-5b463f1ad15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.356398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2396-dc63-4ce9-87be-5b463f1ad15c admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.357209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2396-dc63-4ce9-87be-5b463f1ad15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.360006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2396-dc63-4ce9-87be-5b463f1ad15c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.368003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47862a5d-dc02-4f7c-8cb6-860d2b8f25cb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.375112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.375970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.376344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.376781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.389131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 815/1638] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:31 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:31.390606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b224c7-f394-44cd-9246-590d73e66ff7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.390903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b224c7-f394-44cd-9246-590d73e66ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.391178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b224c7-f394-44cd-9246-590d73e66ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.422931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-99b224c7-f394-44cd-9246-590d73e66ff7 None None] MFA Rules not processed for user `3b69c633ad9a496f924f8f2479eea06d`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:31.424374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-99b224c7-f394-44cd-9246-590d73e66ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:31.454662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.458648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.474405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 824/1639] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:31.475341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.506185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15633d61-61ca-4b26-855b-4016e2c2c0f6 service nova] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.513303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 816/1640] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:31.514673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191745ab-8f7b-4ebc-aa65-e03c8dc62f60 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.514956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191745ab-8f7b-4ebc-aa65-e03c8dc62f60 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.515234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191745ab-8f7b-4ebc-aa65-e03c8dc62f60 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.518136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 817/1641] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 3 02:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:31.518861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191745ab-8f7b-4ebc-aa65-e03c8dc62f60 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.525143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111228-7523-478f-931e-f19b18c90f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.526201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111228-7523-478f-931e-f19b18c90f95 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.526689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111228-7523-478f-931e-f19b18c90f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.527247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111228-7523-478f-931e-f19b18c90f95 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.528304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111228-7523-478f-931e-f19b18c90f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.532381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111228-7523-478f-931e-f19b18c90f95 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.541260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191745ab-8f7b-4ebc-aa65-e03c8dc62f60 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.546724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6f95-5485-4482-8769-6dc7cbfd4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.547667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6f95-5485-4482-8769-6dc7cbfd4635 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.548017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6f95-5485-4482-8769-6dc7cbfd4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.548397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6f95-5485-4482-8769-6dc7cbfd4635 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.549340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6f95-5485-4482-8769-6dc7cbfd4635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.551835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6f95-5485-4482-8769-6dc7cbfd4635 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.565537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 818/1642] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:31.567662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.568019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.568440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.579088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 825/1643] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:31 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:31.582229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.582743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.583233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.596364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] MFA Rules not processed for user `3b69c633ad9a496f924f8f2479eea06d`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:31.598393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:31.607166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 819/1644] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:31.608367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.622348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9449-eafe-4cca-87a6-5fcbd1467dcd None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.629373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.630425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.630875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.631367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] PATH_INFO: `/v3/projects/8457eff34ada4b1cae0ee3352ab7fc4c/users/42a05bb747e54853ac09d47450b230fc/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.632429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:31.638770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:31.654238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8457eff34ada4b1cae0ee3352ab7fc4c, user_id=42a05bb747e54853ac09d47450b230fc, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.657452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.661083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 826/1645] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:56:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:31.662234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.674584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f23b-d0b9-437a-be25-845ffc617591 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.681022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.682014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.682501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.682979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.683968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.686482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.695225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 820/1646] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:31 2022] PUT /identity/v3/projects/8457eff34ada4b1cae0ee3352ab7fc4c/users/42a05bb747e54853ac09d47450b230fc/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:31.696035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.700655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 827/1647] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:31.701772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.712599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b9854-cbbb-4d57-893a-45a952d65736 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.776823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.777808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.778272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.778755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.779765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.781773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.793835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 828/1648] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:31.795136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.807185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560827e2-6c93-4c14-8285-8d2b7cfe8d94 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.812805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.813098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4492a5-d118-44ef-ba4d-028ca2f967d4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.814183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.814705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.815157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] PATH_INFO: `/v3/projects/34d52bdd89304ed397d7cc5704f4148c/users/bd23a6941f714a839e938e52f3d289d6/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.816993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.817642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.817958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.818230 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.833210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d52bdd89304ed397d7cc5704f4148c, user_id=bd23a6941f714a839e938e52f3d289d6, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.836236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.873019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 829/1649] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:31 2022] PUT /identity/v3/projects/34d52bdd89304ed397d7cc5704f4148c/users/bd23a6941f714a839e938e52f3d289d6/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:31.874787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:31.962090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.963727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:31.972735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a661c5-54de-483f-b904-e4218d3fe04a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:31.980271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6d2e3-8c1c-46dc-b957-a1853d6339db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:31.981291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6d2e3-8c1c-46dc-b957-a1853d6339db admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:31.981578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6d2e3-8c1c-46dc-b957-a1853d6339db admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:31.981868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6d2e3-8c1c-46dc-b957-a1853d6339db admin admin] PATH_INFO: `/v3/projects/8457eff34ada4b1cae0ee3352ab7fc4c/users/42a05bb747e54853ac09d47450b230fc/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:31.984253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6d2e3-8c1c-46dc-b957-a1853d6339db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8457eff34ada4b1cae0ee3352ab7fc4c, user_id=42a05bb747e54853ac09d47450b230fc, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:31.987759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6d2e3-8c1c-46dc-b957-a1853d6339db admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:32.001189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 830/1650] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:31 2022] PUT /identity/v3/projects/8457eff34ada4b1cae0ee3352ab7fc4c/users/42a05bb747e54853ac09d47450b230fc/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:32.002504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef906-2c3f-4833-b537-a3fe7c60720f None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.002778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef906-2c3f-4833-b537-a3fe7c60720f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.003191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef906-2c3f-4833-b537-a3fe7c60720f None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.003449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 821/1651] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:32.005972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 831/1652] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 3 02:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:32.006832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:32.012567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8816f-30e5-4f80-bb4f-fb06b60d5810 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.012922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8816f-30e5-4f80-bb4f-fb06b60d5810 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.013202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8816f-30e5-4f80-bb4f-fb06b60d5810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.044480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eb402-675c-4d5d-9452-1f1b4469f52e service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:32.045727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-a6d8816f-30e5-4f80-bb4f-fb06b60d5810 None None] MFA Rules not processed for user `42a05bb747e54853ac09d47450b230fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:32.047138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a6d8816f-30e5-4f80-bb4f-fb06b60d5810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:32.200889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 832/1653] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:32.206412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.207091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.207368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.210253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204cf8e-9224-4a8c-be88-6cd5c34f272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:32.213821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204cf8e-9224-4a8c-be88-6cd5c34f272f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.214232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204cf8e-9224-4a8c-be88-6cd5c34f272f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.214516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204cf8e-9224-4a8c-be88-6cd5c34f272f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.217393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204cf8e-9224-4a8c-be88-6cd5c34f272f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:32.220257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204cf8e-9224-4a8c-be88-6cd5c34f272f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:32.246944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 822/1654] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:32.249424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.249725 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.250147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.251560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:32.252883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:32.290443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] MFA Rules not processed for user `087b5f4f3891413b8b7fa727768c09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:32.292103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:32.395402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 833/1655] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:32.396288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:32.460470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 823/1656] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:32.460470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:32.486599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dd31d-467a-4441-a9f1-f9073ff3b7e4 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:32.502560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bf2a7-66bc-44bb-92a8-0ad90aeb67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:32.503484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bf2a7-66bc-44bb-92a8-0ad90aeb67d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.503832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bf2a7-66bc-44bb-92a8-0ad90aeb67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.504104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bf2a7-66bc-44bb-92a8-0ad90aeb67d1 admin admin] PATH_INFO: `/v3/projects/34d52bdd89304ed397d7cc5704f4148c/users/bd23a6941f714a839e938e52f3d289d6/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.504236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b305-7158-4e71-8dfa-16075ffb3cb4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:32.506783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bf2a7-66bc-44bb-92a8-0ad90aeb67d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d52bdd89304ed397d7cc5704f4148c, user_id=bd23a6941f714a839e938e52f3d289d6, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:32.519650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bf2a7-66bc-44bb-92a8-0ad90aeb67d1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:32.525923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b54b-bee8-43a0-a5df-e48a3e9a13af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:32.528786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b54b-bee8-43a0-a5df-e48a3e9a13af service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.530470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b54b-bee8-43a0-a5df-e48a3e9a13af service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.530851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b54b-bee8-43a0-a5df-e48a3e9a13af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.542311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 824/1657] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:32 2022] PUT /identity/v3/projects/34d52bdd89304ed397d7cc5704f4148c/users/bd23a6941f714a839e938e52f3d289d6/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:32.543302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b2381-03d0-468e-892d-e16bda30467f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.543585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b2381-03d0-468e-892d-e16bda30467f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.543856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b2381-03d0-468e-892d-e16bda30467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.559125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3b54b-bee8-43a0-a5df-e48a3e9a13af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:32.560606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3b54b-bee8-43a0-a5df-e48a3e9a13af service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:32.575134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-500b2381-03d0-468e-892d-e16bda30467f None None] MFA Rules not processed for user `087b5f4f3891413b8b7fa727768c09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:32.577149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-500b2381-03d0-468e-892d-e16bda30467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:32.583990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 834/1658] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:32 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:32.588904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.589467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.589755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.650847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] MFA Rules not processed for user `bd23a6941f714a839e938e52f3d289d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:32.654783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:32.724612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 825/1659] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:32.725621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b2381-03d0-468e-892d-e16bda30467f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:32.793733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b2381-03d0-468e-892d-e16bda30467f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:32.798370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:32.799468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:32.800143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:32.800426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:32.821833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 835/1660] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:32.943899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:32.945741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:32.977798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 826/1661] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:32.992160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:33.002801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9356b-c12f-4054-991d-b6a54c43d0a7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:33.008114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:33.009104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:33.009548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:33.009962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:33.021586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:33.023055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:33.045124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 836/1662] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:33.151708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:33.170015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e649-869c-4d84-9540-6a157d5a51f8 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:33.186439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:33.188854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:33.188854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:33.190876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:33.285719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:33.288248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:33.307989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 827/1663] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:33.374367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:33.385737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf323a-62c5-4e48-b21d-e36f72b0e366 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:33.396966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadb25b-f343-4def-af85-4b565a722e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:33.398726 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadb25b-f343-4def-af85-4b565a722e83 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:33.400918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadb25b-f343-4def-af85-4b565a722e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:33.401456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadb25b-f343-4def-af85-4b565a722e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:33.538975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadb25b-f343-4def-af85-4b565a722e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:33.540473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadb25b-f343-4def-af85-4b565a722e83 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:33.559849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 837/1664] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:33.910505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:33.926424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0449-1ef8-4736-a839-18175eda164f service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:33.949322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c43f-4208-4486-ba82-1e128a829165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:33.950074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c43f-4208-4486-ba82-1e128a829165 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:33.952045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c43f-4208-4486-ba82-1e128a829165 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:33.952281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c43f-4208-4486-ba82-1e128a829165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:33.974715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c43f-4208-4486-ba82-1e128a829165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:33.980683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c43f-4208-4486-ba82-1e128a829165 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:34.006837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 828/1665] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:34.293174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0e18-184f-4372-acd1-ddef0d69745b None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:34.293972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0e18-184f-4372-acd1-ddef0d69745b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:34.294718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0e18-184f-4372-acd1-ddef0d69745b None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:34.300907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 838/1666] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 3 02:56:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:34.308306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36fd62-a25b-4480-899e-05b2569fb3d8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:34.309405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36fd62-a25b-4480-899e-05b2569fb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:34.309939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36fd62-a25b-4480-899e-05b2569fb3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:34.396178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3d36fd62-a25b-4480-899e-05b2569fb3d8 None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:34.397970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3d36fd62-a25b-4480-899e-05b2569fb3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:34.463121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 829/1667] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:34.491884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0e18-184f-4372-acd1-ddef0d69745b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:34.508588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0e18-184f-4372-acd1-ddef0d69745b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:34.513578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a51e0c-2a15-4a11-a07b-eb358bd5e65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:34.514792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a51e0c-2a15-4a11-a07b-eb358bd5e65b service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:34.515143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a51e0c-2a15-4a11-a07b-eb358bd5e65b service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:34.515566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a51e0c-2a15-4a11-a07b-eb358bd5e65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:34.525071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a51e0c-2a15-4a11-a07b-eb358bd5e65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:34.526641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a51e0c-2a15-4a11-a07b-eb358bd5e65b service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:34.539642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 839/1668] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:34.563344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e019-180b-4f07-9b61-390e2258b97d None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:34.563344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e019-180b-4f07-9b61-390e2258b97d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:34.563344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e019-180b-4f07-9b61-390e2258b97d None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:34.565360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 830/1669] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 3 02:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:34.572401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:34.572982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:34.573503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:34.606888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:34.609110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:34.619706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 840/1670] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:34.699985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e019-180b-4f07-9b61-390e2258b97d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:34.716570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e019-180b-4f07-9b61-390e2258b97d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:34.723565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd08cdb-686f-437e-9c48-7cf07f45be3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:34.724344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd08cdb-686f-437e-9c48-7cf07f45be3f service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:34.724733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd08cdb-686f-437e-9c48-7cf07f45be3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:34.725103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd08cdb-686f-437e-9c48-7cf07f45be3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:34.747097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd08cdb-686f-437e-9c48-7cf07f45be3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:34.752475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd08cdb-686f-437e-9c48-7cf07f45be3f service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:34.778768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 831/1671] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:35.964503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:36.178124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20d3a9-6b96-4d57-bf43-cbc070e4c449 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:36.190874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125b46-ad15-487f-9b62-a8711c98f45a None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:36.191836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125b46-ad15-487f-9b62-a8711c98f45a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:36.191836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125b46-ad15-487f-9b62-a8711c98f45a None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:36.194532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 832/1672] 10.222.0.31 () {54 vars in 960 bytes} [Thu Feb 3 02:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 03 02:56:36.196857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:36.197990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:36.201137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:36.201442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:36.201675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:36.204106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:36.204474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:36.216216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:36.282465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] MFA Rules not processed for user `d598cc17e70b46058bd824c031a0186c`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:36.283946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:36.306554 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:36.308158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:36.330582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 833/1673] 10.222.0.31 () {58 vars in 1057 bytes} [Thu Feb 3 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:36.340762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:36.350484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 841/1674] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:36.386038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccaec-baf1-4da7-9375-a063a966de0d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:36.440242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346a649-25bd-4be9-97cd-06d4354d772e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:36.441737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346a649-25bd-4be9-97cd-06d4354d772e service placement] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:36.445494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346a649-25bd-4be9-97cd-06d4354d772e service placement] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:36.445829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346a649-25bd-4be9-97cd-06d4354d772e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:36.463518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:36.484352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346a649-25bd-4be9-97cd-06d4354d772e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:36.489099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346a649-25bd-4be9-97cd-06d4354d772e service placement] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:36.511467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 834/1675] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:36.597974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f63af-f78c-4cfc-829b-6f81552a599b service placement] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:36.611838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:36.612975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:36.615091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:36.615677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] PATH_INFO: `/v3/users/82700debf402442db1defe05c44641a4` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:36.618947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82700debf402442db1defe05c44641a4)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:36.621187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:36.712230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82700debf402442db1defe05c44641a4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:36.714371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82700debf402442db1defe05c44641a4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:36.730859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82700debf402442db1defe05c44641a4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:36.750399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82700debf402442db1defe05c44641a4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:36.764484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82700debf402442db1defe05c44641a4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:36.774291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 842/1676] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:36 2022] DELETE /identity/v3/users/82700debf402442db1defe05c44641a4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:36.778709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f59cb-b5f1-4fc8-857a-8b0540c39523 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:36.779005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f59cb-b5f1-4fc8-857a-8b0540c39523 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:36.779302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f59cb-b5f1-4fc8-857a-8b0540c39523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:36.806540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8e3f59cb-b5f1-4fc8-857a-8b0540c39523 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:36.808072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8e3f59cb-b5f1-4fc8-857a-8b0540c39523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:37.017887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 835/1677] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:37.062011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:37.064105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:37.265535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9481ae-26c8-4968-b176-0172ac500b88 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:37.275196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375e01-b9e4-4e49-afa2-77732ce10c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:37.275196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375e01-b9e4-4e49-afa2-77732ce10c8d service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:37.275490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375e01-b9e4-4e49-afa2-77732ce10c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:37.275771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375e01-b9e4-4e49-afa2-77732ce10c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:37.311743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375e01-b9e4-4e49-afa2-77732ce10c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:37.316548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375e01-b9e4-4e49-afa2-77732ce10c8d service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:37.343348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 843/1678] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:38.157570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:38.158261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:38.158261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:38.203498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] MFA Rules not processed for user `f755cdacf8054a9e916ec75f1dedc105`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:38.205763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:38.333838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 836/1679] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:38.344547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:38.345070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:38.345273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:38.363953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] MFA Rules not processed for user `f755cdacf8054a9e916ec75f1dedc105`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:38.365320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:38.377611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 844/1680] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:38.385016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:38.386996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:38.449409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:38.450929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:38.474587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e2da2-39c4-42a4-af3e-2190b93f6a45 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:38.487083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:38.489446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:38.490519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:38.490968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] PATH_INFO: `/v3/projects/f75fb8e584c04ce481262c99952f2b71` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:38.493829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75fb8e584c04ce481262c99952f2b71)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:38.495105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: WARNING py.warnings [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:56:38.495105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: warnings.warn(msg) Feb 03 02:56:38.495105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: Feb 03 02:56:38.497553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:38.513743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824481c-9804-431d-9abe-a90c6767f7dc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:38.541086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:38.541883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:38.543652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:38.544256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:38.558292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:38.560247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:38.574479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 837/1681] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:38.629924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75fb8e584c04ce481262c99952f2b71', 'request_id': 'req-a8c4da89-233c-4dbf-9a86-f4519ee6c330'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.663147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75fb8e584c04ce481262c99952f2b71', 'request_id': 'req-a8c4da89-233c-4dbf-9a86-f4519ee6c330'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.679973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75fb8e584c04ce481262c99952f2b71', 'request_id': 'req-a8c4da89-233c-4dbf-9a86-f4519ee6c330'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.713575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] The token cache is being invalidate because project f75fb8e584c04ce481262c99952f2b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:38.715722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.716901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.722621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 845/1682] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:38 2022] DELETE /identity/v3/projects/f75fb8e584c04ce481262c99952f2b71 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:38.727605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:38.747842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde64ce-23eb-445d-b7b4-20e1e26ec371 service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:38.835713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:38.838065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:38.838792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:38.839522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] PATH_INFO: `/v3/users/42a05bb747e54853ac09d47450b230fc` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:38.841757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a05bb747e54853ac09d47450b230fc)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:38.843504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: WARNING py.warnings [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:56:38.843504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: warnings.warn(msg) Feb 03 02:56:38.843504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: Feb 03 02:56:38.845137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:38.971179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a05bb747e54853ac09d47450b230fc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.986992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a05bb747e54853ac09d47450b230fc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:38.987969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a05bb747e54853ac09d47450b230fc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.011110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a05bb747e54853ac09d47450b230fc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.047732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cf33bb90-f93c-446a-9d82-74f596eaa790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a05bb747e54853ac09d47450b230fc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.056773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 838/1683] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:38 2022] DELETE /identity/v3/users/42a05bb747e54853ac09d47450b230fc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:39.464693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:39.466281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:39.489961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4da89-233c-4dbf-9a86-f4519ee6c330 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:39.581235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:39.582197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:39.582499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:39.582778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] PATH_INFO: `/v3/projects/8457eff34ada4b1cae0ee3352ab7fc4c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:39.584061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8457eff34ada4b1cae0ee3352ab7fc4c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:39.586073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:39.643826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8457eff34ada4b1cae0ee3352ab7fc4c', 'request_id': 'req-e10242fc-7308-4779-831d-07f6a4269782'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.651100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8457eff34ada4b1cae0ee3352ab7fc4c', 'request_id': 'req-e10242fc-7308-4779-831d-07f6a4269782'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.657934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8457eff34ada4b1cae0ee3352ab7fc4c', 'request_id': 'req-e10242fc-7308-4779-831d-07f6a4269782'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.680550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] The token cache is being invalidate because project 8457eff34ada4b1cae0ee3352ab7fc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:39.680893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.681637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e10242fc-7308-4779-831d-07f6a4269782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:39.683801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 846/1684] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:39 2022] DELETE /identity/v3/projects/8457eff34ada4b1cae0ee3352ab7fc4c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:39.690325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:39.690821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:39.690938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:39.727185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:39.729484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:39.813020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 839/1685] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:39.820805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:39.821470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:39.822040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:39.880913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:39.883400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:39.907821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 847/1686] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:39.910273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:39.937532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079239-2e0b-4eae-bc0b-9d6eaa42c21f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:39.943477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:39.944286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:39.944577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:39.944903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:39.945665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:39.945970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:39.951393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:39.979490 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 840/1687] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:39.983621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:39.993773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b40ef-6915-4fd1-ba7e-a86500f7a6a2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:40.011477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:40.012349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.012690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.013064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.013850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:40.023479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:40.070671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 848/1688] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:39 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:40.071786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:40.087669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b066e-b7dc-4a38-931f-d450374c2503 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:40.277584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:40.277584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.277584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.277584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.280491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:40.280491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:40.289297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 841/1689] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:40 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:40.293131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:40.308599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f9e70-9ef7-42fd-b782-8e8fde94b6af admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:40.317423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:40.318108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.318542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.318814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.319611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:40.321281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:40.362960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 849/1690] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:40.367716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:40.386620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1591f4-b10a-4900-9d19-f409ab5f1c18 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:40.395472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef363c2-7532-4741-960f-0bf87c0708ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:40.401218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef363c2-7532-4741-960f-0bf87c0708ba admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.402311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef363c2-7532-4741-960f-0bf87c0708ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.403576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef363c2-7532-4741-960f-0bf87c0708ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.405962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef363c2-7532-4741-960f-0bf87c0708ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:40.413060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef363c2-7532-4741-960f-0bf87c0708ba admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:40.459129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 842/1691] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:40.463745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:40.481549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a19431-14ac-446b-8a63-d248d31c3263 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:40.487986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.488164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.488346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.502625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41289ff1-a098-4519-8b69-e125e6b5074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:40.509633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41289ff1-a098-4519-8b69-e125e6b5074d admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.510046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41289ff1-a098-4519-8b69-e125e6b5074d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.510372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41289ff1-a098-4519-8b69-e125e6b5074d admin admin] PATH_INFO: `/v3/projects/5185694a810b420b84c3f5f983cc6a35/users/3ac7b48c90e1477d9b1e854ea2441686/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.570812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] MFA Rules not processed for user `f755cdacf8054a9e916ec75f1dedc105`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:40.573317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:40.578423 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41289ff1-a098-4519-8b69-e125e6b5074d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5185694a810b420b84c3f5f983cc6a35, user_id=3ac7b48c90e1477d9b1e854ea2441686, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:40.593254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41289ff1-a098-4519-8b69-e125e6b5074d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:40.633934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 850/1692] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:40 2022] PUT /identity/v3/projects/5185694a810b420b84c3f5f983cc6a35/users/3ac7b48c90e1477d9b1e854ea2441686/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:40.644831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:40.645284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:40.645567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:40.728222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 843/1693] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:40.759038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] MFA Rules not processed for user `3ac7b48c90e1477d9b1e854ea2441686`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:40.760403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:40.925711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 851/1694] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:40.927521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:40.949768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc3f7-dbae-4274-836e-72a8e9d03172 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.054265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.055544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.055995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.056448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.058320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.060409 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.122782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 844/1695] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:40 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:41.123248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:41.142234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e0bd-e16f-47c5-9158-b07edabf30da None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.225965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.226922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.227372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.227787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.228645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.231666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.262046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 852/1696] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:41 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:56:41.266228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:41.278587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44071a6-6d87-4b23-9f64-8049290dac29 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.294001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.295857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.296935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.297902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.300805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.302417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.338761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 845/1697] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:41.340886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:41.359390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551774-3ccb-485b-a288-5bed4c66a0df admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.376561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.378880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.379308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.379825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] PATH_INFO: `/v3/projects/139774d35cf44fa5a865af6aa5bad917/users/9941ddc2f1ee4307bb07e135f3bf84da/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.408808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139774d35cf44fa5a865af6aa5bad917, user_id=9941ddc2f1ee4307bb07e135f3bf84da, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.411657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.453723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 853/1698] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:41 2022] PUT /identity/v3/projects/139774d35cf44fa5a865af6aa5bad917/users/9941ddc2f1ee4307bb07e135f3bf84da/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:41.458016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:41.472106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa590-f765-4331-8fa7-f15dde32e183 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.576102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33c04-381e-4428-93ed-0c131907d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.576967 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33c04-381e-4428-93ed-0c131907d0be admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.577433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33c04-381e-4428-93ed-0c131907d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.577924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33c04-381e-4428-93ed-0c131907d0be admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.578678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac33c04-381e-4428-93ed-0c131907d0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.580535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac33c04-381e-4428-93ed-0c131907d0be admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.605921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 846/1699] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:41.607407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:41.620943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca06de-e06c-4864-b75b-3313dfcf7a48 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.629452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.630472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.630871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.631261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] PATH_INFO: `/v3/projects/139774d35cf44fa5a865af6aa5bad917/users/9941ddc2f1ee4307bb07e135f3bf84da/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.637077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139774d35cf44fa5a865af6aa5bad917, user_id=9941ddc2f1ee4307bb07e135f3bf84da, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.639977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.655148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 854/1700] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:41 2022] PUT /identity/v3/projects/139774d35cf44fa5a865af6aa5bad917/users/9941ddc2f1ee4307bb07e135f3bf84da/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:41.665329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.665687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.666156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.699274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] MFA Rules not processed for user `9941ddc2f1ee4307bb07e135f3bf84da`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:41.700790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:41.796241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 847/1701] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:41.804106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:41.805938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:41.886191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2b369-2d9b-4c8a-b8cf-e45306d1c361 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:41.903642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9aa77-8d7d-4050-b192-bc95e67d09a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:41.904483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9aa77-8d7d-4050-b192-bc95e67d09a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:41.904899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9aa77-8d7d-4050-b192-bc95e67d09a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:41.905269 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9aa77-8d7d-4050-b192-bc95e67d09a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:41.920654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9aa77-8d7d-4050-b192-bc95e67d09a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:41.922373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9aa77-8d7d-4050-b192-bc95e67d09a4 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:41.948201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 855/1702] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:41.982047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:42.120218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19036444-224f-4b89-b1e2-c8b95544fe19 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:42.134402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:42.135305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:42.135571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:42.135843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] PATH_INFO: `/v3/users/3ac7b48c90e1477d9b1e854ea2441686` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:42.148288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac7b48c90e1477d9b1e854ea2441686)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:42.152809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:42.231116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac7b48c90e1477d9b1e854ea2441686'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:42.244299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac7b48c90e1477d9b1e854ea2441686'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:42.245206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac7b48c90e1477d9b1e854ea2441686'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:42.256938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac7b48c90e1477d9b1e854ea2441686'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:42.269424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac7b48c90e1477d9b1e854ea2441686'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:42.277413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 848/1703] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:41 2022] DELETE /identity/v3/users/3ac7b48c90e1477d9b1e854ea2441686 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:42.282278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218e2a-2834-4c95-8351-a1063668e5a9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:42.282566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218e2a-2834-4c95-8351-a1063668e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:42.282910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218e2a-2834-4c95-8351-a1063668e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:42.310219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ab218e2a-2834-4c95-8351-a1063668e5a9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:42.312169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ab218e2a-2834-4c95-8351-a1063668e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:42.427196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 856/1704] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:42.436067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:42.437712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:42.510926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac633-8b1e-4e6b-92c7-908e1f5d3c2a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:42.515303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:42.516302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:42.517066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:42.517370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:42.529510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:42.531275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:42.549261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:42.549683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:42.550077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:42.560631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 849/1705] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:42.600168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] MFA Rules not processed for user `076a8d1b26864240a8007d2ac7080e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:42.601929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:42.719743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 857/1706] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:42.733110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:42.734705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:42.832865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee8f6-4a91-40a0-ab1d-266cf27b263e service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:42.840072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:42.841020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:42.854624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:42.855276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:42.875659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:42.877629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:42.901817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 850/1707] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:43.181307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:43.182858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:43.200601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb0ec-0274-4cd8-900c-7e7c98fd36ca None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:43.206356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:43.208293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:43.208775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:43.209313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] PATH_INFO: `/v3/projects/5185694a810b420b84c3f5f983cc6a35` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:43.210924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5185694a810b420b84c3f5f983cc6a35)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:43.213406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:43.281750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5185694a810b420b84c3f5f983cc6a35', 'request_id': 'req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.296190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5185694a810b420b84c3f5f983cc6a35', 'request_id': 'req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.308736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5185694a810b420b84c3f5f983cc6a35', 'request_id': 'req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.340129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] The token cache is being invalidate because project 5185694a810b420b84c3f5f983cc6a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:43.342064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.344655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.348564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 858/1708] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:43 2022] DELETE /identity/v3/projects/5185694a810b420b84c3f5f983cc6a35 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:43.352514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:43.369415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53b12e-fa0e-4ae4-9454-804a742b95a3 service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:43.493586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:43.494502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:43.494818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:43.495146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] PATH_INFO: `/v3/users/9941ddc2f1ee4307bb07e135f3bf84da` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:43.497776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9941ddc2f1ee4307bb07e135f3bf84da)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:43.499758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:43.596918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9941ddc2f1ee4307bb07e135f3bf84da'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.623533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9941ddc2f1ee4307bb07e135f3bf84da'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.626222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9941ddc2f1ee4307bb07e135f3bf84da'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.659059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9941ddc2f1ee4307bb07e135f3bf84da'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.688217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9941ddc2f1ee4307bb07e135f3bf84da'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:43.704374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 851/1709] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:43 2022] DELETE /identity/v3/users/9941ddc2f1ee4307bb07e135f3bf84da => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:44.318952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:44.320570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:44.355104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bde45-63ce-4bd8-afe1-d1cea42c2ca7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:44.532305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:44.537598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:44.539680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:44.540591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:44.540899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:44.541171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] PATH_INFO: `/v3/users/4b315117edec4110ba8432c5a7284300` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:44.548530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b315117edec4110ba8432c5a7284300)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:44.550906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:44.576756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d2f2d-aad8-463d-990a-a9f889782a83 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:44.593780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:44.613935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:44.615137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:44.615435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] PATH_INFO: `/v3/projects/139774d35cf44fa5a865af6aa5bad917` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:44.620033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=139774d35cf44fa5a865af6aa5bad917)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:44.622529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:44.661442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b315117edec4110ba8432c5a7284300'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.665191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b315117edec4110ba8432c5a7284300'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.681421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b315117edec4110ba8432c5a7284300'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.723352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b315117edec4110ba8432c5a7284300'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.757984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ffea3ce7-f6f8-41cd-9e4e-d79fff1b1f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b315117edec4110ba8432c5a7284300'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.777257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 859/1710] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:44 2022] DELETE /identity/v3/users/4b315117edec4110ba8432c5a7284300 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:44.779193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019db9c-51a9-4da8-8860-13fb22c3de02 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:44.780117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019db9c-51a9-4da8-8860-13fb22c3de02 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:44.780117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019db9c-51a9-4da8-8860-13fb22c3de02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:44.816623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139774d35cf44fa5a865af6aa5bad917', 'request_id': 'req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.850923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d019db9c-51a9-4da8-8860-13fb22c3de02 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:44.855024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139774d35cf44fa5a865af6aa5bad917', 'request_id': 'req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.856606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d019db9c-51a9-4da8-8860-13fb22c3de02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:44.881036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139774d35cf44fa5a865af6aa5bad917', 'request_id': 'req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.929399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] The token cache is being invalidate because project 139774d35cf44fa5a865af6aa5bad917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:44.930683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.939055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5b8d3b7a-0a18-48eb-bcad-bbe140d584ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:44.950020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 852/1711] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:44 2022] DELETE /identity/v3/projects/139774d35cf44fa5a865af6aa5bad917 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:44.959536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:44.959818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:44.960103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.008009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 860/1712] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:45.054098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:45.059855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:45.122050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 853/1713] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:45.130174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.130511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.130778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.151596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.153676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:45.169481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:45.173038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:45.196185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 861/1714] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:45.197338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.218668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37907ab-7025-49bb-b307-8cdfdab740dd None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.246922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.249764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.250705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.251092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.251882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:45.252194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.263989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf769a-ffe5-49aa-a17e-0279b98a71fc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:45.315438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 862/1715] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:45.316955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.317242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.320931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.377946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:45.379175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:45.393524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20cbba-aa0c-45a3-b814-14b55b850120 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.409294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.409294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.409294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.409294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.453630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.455316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:45.495524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 854/1716] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:45.496409 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.538883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d877-a5e4-4821-9454-f6f2535332f8 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.573023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.573843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.574016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.575093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.575828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.579016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:45.603736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 863/1717] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:45.643561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 855/1718] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:45 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:45.648843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.664929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd45fc-3fec-40f3-b100-068b538f456d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.730458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.731552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.731933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.732308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.733347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.736115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:45.784293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 864/1719] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:45 2022] POST /identity/v3/users => generated 304 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:45.791644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.809173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541135e-c020-44e5-96b0-89ba6c7aa50a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.817624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.818825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.819238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.819684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.820820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.823965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:45.847107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 856/1720] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:45.852288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.865096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497b32-59a5-409f-a5b9-0285a93c6618 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.891005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.891005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.891005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.891005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.891395 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.893493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:45.911024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 865/1721] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:45.911905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.925129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4304a04-0a89-4624-91b4-c19167f4c467 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:45.930274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bafcf7-0d20-426b-a9c8-3e93db061b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:45.931621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafcf7-0d20-426b-a9c8-3e93db061b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:45.932333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafcf7-0d20-426b-a9c8-3e93db061b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:45.932333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafcf7-0d20-426b-a9c8-3e93db061b2c admin admin] PATH_INFO: `/v3/projects/4d076b76f0d14a75a5a71132398e2df1/users/7c997f6c426544f39336dae650d66d60/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:45.952174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:45.954138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:45.966599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafcf7-0d20-426b-a9c8-3e93db061b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d076b76f0d14a75a5a71132398e2df1, user_id=7c997f6c426544f39336dae650d66d60, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:45.969657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafcf7-0d20-426b-a9c8-3e93db061b2c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:46.034793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 857/1722] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:45 2022] PUT /identity/v3/projects/4d076b76f0d14a75a5a71132398e2df1/users/7c997f6c426544f39336dae650d66d60/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:46.037503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:46.038326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:46.038784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:46.101192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] MFA Rules not processed for user `7c997f6c426544f39336dae650d66d60`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:46.102420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:46.157828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158399-2647-49fc-81bf-efdf36d6b320 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:46.232453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 858/1723] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:46.234842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:46.241364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:46.338830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:46.341385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:46.345484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:46.346376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:46.453180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51e20f-3b3c-4a94-93ec-c7d2badd68ba None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:46.484128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:46.485524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:46.486104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:46.487101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] PATH_INFO: `/v3/users/3e843b98d61545b1841cf07400423dd4` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:46.489694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e843b98d61545b1841cf07400423dd4)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:46.492664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:46.574487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:46.580096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:46.580737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e843b98d61545b1841cf07400423dd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:46.612710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 866/1724] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:56:46.613890 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:46.623534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e843b98d61545b1841cf07400423dd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:46.625965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e843b98d61545b1841cf07400423dd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:46.652811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5aee4-8eca-422a-95d3-e02351e65fd1 service swift] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:46.665072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e843b98d61545b1841cf07400423dd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:46.676307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:46.678038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:46.678167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:46.678367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:46.680993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:46.683035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:46.712930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-68c544ba-012c-43d1-8933-1672cf41aff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e843b98d61545b1841cf07400423dd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:46.738792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 859/1725] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:46 2022] DELETE /identity/v3/users/3e843b98d61545b1841cf07400423dd4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:46.744252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:46.744943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:46.745242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:46.808845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:46.814452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:46.885106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 867/1726] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:46 2022] POST /identity/v3/projects => generated 409 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:46.889914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:46.902699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:47.053577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 860/1727] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:47.143279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864763e-b3d9-4ddd-936c-5075e6af091d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.162984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:47.167217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:47.171132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.172184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.172636 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.173045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.174047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.176276 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.211824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 868/1728] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:46 2022] POST /identity/v3/users => generated 311 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:47.216018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:47.232671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc9ca3-1fc9-4fd8-aa93-071efc03078d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.252982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.254091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.254512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.254929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.255991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.260096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.299919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 869/1729] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:47.304869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:47.317956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1e16-82b3-4d7e-b293-55e8704b0fba None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.323770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991387-5b97-4513-9087-0487e5819560 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.336559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.337505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.338866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.338866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] PATH_INFO: `/v3/projects/ac1cb3a176f5462c9709700a9aeb3a8c/users/636fb698c6744b21be963f56176e11c3/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.396693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1cb3a176f5462c9709700a9aeb3a8c, user_id=636fb698c6744b21be963f56176e11c3, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.416517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.462856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 870/1730] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:47 2022] PUT /identity/v3/projects/ac1cb3a176f5462c9709700a9aeb3a8c/users/636fb698c6744b21be963f56176e11c3/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:47.467164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:47.494077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.495104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.495379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.495644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.554055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.555683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.579940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 861/1731] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:47.592640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:47.596271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:47.625620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed71c8-2c52-4713-84fb-3a2b1007fcff service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.647456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ffce-1a96-493f-a9d3-a4177f99f620 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.661030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.661843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.662127 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.662410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.663163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.664903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.705681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 871/1732] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:47.717425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:47.752404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e94a-1162-421a-a45b-0736300addd6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:47.769413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f51926-2c14-4973-970c-526a198de15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.770326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f51926-2c14-4973-970c-526a198de15c admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.776970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f51926-2c14-4973-970c-526a198de15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.777319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f51926-2c14-4973-970c-526a198de15c admin admin] PATH_INFO: `/v3/projects/ac1cb3a176f5462c9709700a9aeb3a8c/users/636fb698c6744b21be963f56176e11c3/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.784764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f51926-2c14-4973-970c-526a198de15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1cb3a176f5462c9709700a9aeb3a8c, user_id=636fb698c6744b21be963f56176e11c3, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.795314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f51926-2c14-4973-970c-526a198de15c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.810504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:47.813616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.813946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.817616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] PATH_INFO: `/v3/projects/17f313a1b92c4e11886efd554edbb0b2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.819402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f313a1b92c4e11886efd554edbb0b2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:47.824803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:47.836510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 872/1733] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:47 2022] PUT /identity/v3/projects/ac1cb3a176f5462c9709700a9aeb3a8c/users/636fb698c6744b21be963f56176e11c3/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:47.857557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:47.857557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:47.857557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:47.980559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] MFA Rules not processed for user `636fb698c6744b21be963f56176e11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:47.981827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:48.022584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f313a1b92c4e11886efd554edbb0b2', 'request_id': 'req-195378a6-6d42-45d6-85da-fdc5f2bfeea6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:48.048036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f313a1b92c4e11886efd554edbb0b2', 'request_id': 'req-195378a6-6d42-45d6-85da-fdc5f2bfeea6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:48.079995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f313a1b92c4e11886efd554edbb0b2', 'request_id': 'req-195378a6-6d42-45d6-85da-fdc5f2bfeea6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:48.121326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] The token cache is being invalidate because project 17f313a1b92c4e11886efd554edbb0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:48.121626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:48.127651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-195378a6-6d42-45d6-85da-fdc5f2bfeea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:48.141146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 862/1734] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:47 2022] DELETE /identity/v3/projects/17f313a1b92c4e11886efd554edbb0b2 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:48.141146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d942-b1c6-455f-91fa-93f78eb1a600 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:48.141146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d942-b1c6-455f-91fa-93f78eb1a600 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:48.141146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d942-b1c6-455f-91fa-93f78eb1a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:48.206612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f824d942-b1c6-455f-91fa-93f78eb1a600 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:48.210149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f824d942-b1c6-455f-91fa-93f78eb1a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:48.317579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 873/1735] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:48.329795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:48.337968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:48.373584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 863/1736] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:48.382946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:48.383512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:48.383512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:48.424912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:48.430956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:48.466188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 864/1737] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:48.469228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:48.486483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486c1b-1c35-4226-92ab-35542b13e309 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:48.492816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ce376-3ca1-4d4b-bdea-c66a5b14a5ff None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:48.498264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd56476-197e-40b9-b5c9-190f31493bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:48.499351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd56476-197e-40b9-b5c9-190f31493bff service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:48.499624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd56476-197e-40b9-b5c9-190f31493bff service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:48.499893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd56476-197e-40b9-b5c9-190f31493bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:48.513035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:48.519054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:48.519789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:48.520041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:48.520852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:48.521157 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:48.531091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:48.552217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd56476-197e-40b9-b5c9-190f31493bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:48.558033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd56476-197e-40b9-b5c9-190f31493bff service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:48.566625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 865/1738] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:48.578443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:48.601679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965063-62e1-4a7c-8b24-5106792d5f5a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:48.613310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 874/1739] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:48.615605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:48.620188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:48.620539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:48.620863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:48.624470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:48.634424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:48.664052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:48.664052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:48.664340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:48.727359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:48.727359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:48.754171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 866/1740] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:48 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:56:48.756357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:48.986601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 875/1741] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Feb 3 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:49.017137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2193ba1-106e-4907-919c-372a6ca3583b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.028650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.029458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.029740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.034589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.035660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.050085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.053058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.054570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:49.080018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537fb3-d09f-4a90-bf52-3f88266591d9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.116253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 867/1742] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:48 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:49.117942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.154953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc50fc-3739-4fab-880d-f565f3929689 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.181711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.182471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.182795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.183077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.183890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.185696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.237155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 868/1743] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:56:49.238166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.248597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:49.279507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.281945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.282856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.283895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.289161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:49.466691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.468136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.485484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 876/1744] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:49.486872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.490045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18832-89a0-4c23-a3c3-4cc4499ff48b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.497441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.498146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.498428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.498704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.502238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4158c-b51e-4351-84c0-d5ef0777d508 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.508383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.509323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.509775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.511155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.517721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.519334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.526761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.540861 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.569676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 869/1745] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:49.570476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.580830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 877/1746] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:49.585951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.585951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:49.620255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f648bc-81d9-4b3e-9b3f-37acdc2cefa5 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.635381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590bc9c-f0c7-4537-bf42-ee032c5f9811 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.642709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.643664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.643972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.644932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] PATH_INFO: `/v3/projects/818a964e58b641b590d96b84862e1f58` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.647566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818a964e58b641b590d96b84862e1f58)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.649952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.650470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.650659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.650944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.651219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:49.652279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:49.663439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:49.704613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 870/1747] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:49.723515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.733348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:49.794344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818a964e58b641b590d96b84862e1f58', 'request_id': 'req-e5b96cc0-b932-4982-8847-338b1397ac36'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:49.797143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31face6-075a-4ef3-a4c0-95514e1b0a84 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:49.812366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818a964e58b641b590d96b84862e1f58', 'request_id': 'req-e5b96cc0-b932-4982-8847-338b1397ac36'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:49.836197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818a964e58b641b590d96b84862e1f58', 'request_id': 'req-e5b96cc0-b932-4982-8847-338b1397ac36'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:49.868364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] The token cache is being invalidate because project 818a964e58b641b590d96b84862e1f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:49.871320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:49.873043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:49.878088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 878/1748] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:49 2022] DELETE /identity/v3/projects/818a964e58b641b590d96b84862e1f58 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:49.879856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:49.883839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:49.986989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:49.988897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:49.989190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:49.989623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.001849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:50.054887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:50.060239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9837ff1-7b0e-4d24-8954-c823001d01d9 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:50.090619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 871/1749] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:50.092397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055772e-feab-4359-ba67-33436e76c5c5 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.093102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055772e-feab-4359-ba67-33436e76c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.093531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055772e-feab-4359-ba67-33436e76c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.147834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2055772e-feab-4359-ba67-33436e76c5c5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:50.149101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2055772e-feab-4359-ba67-33436e76c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:50.158088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96cc0-b932-4982-8847-338b1397ac36 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:50.173094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35b356-a11a-4286-88a3-8f375208d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:50.174711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35b356-a11a-4286-88a3-8f375208d599 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.175043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35b356-a11a-4286-88a3-8f375208d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.175489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35b356-a11a-4286-88a3-8f375208d599 admin admin] PATH_INFO: `/v3/projects/204c1fd85bf546caae90db7ef5d7e723/users/b66987c51a2c49a5971da006ace95f7b/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.206155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 872/1750] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:50.214619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.215340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.215777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.219487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35b356-a11a-4286-88a3-8f375208d599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204c1fd85bf546caae90db7ef5d7e723, user_id=b66987c51a2c49a5971da006ace95f7b, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:50.225817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35b356-a11a-4286-88a3-8f375208d599 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:50.252778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 879/1751] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:49 2022] PUT /identity/v3/projects/204c1fd85bf546caae90db7ef5d7e723/users/b66987c51a2c49a5971da006ace95f7b/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:50.263359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.264009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.264593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.269246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:50.270888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:50.357712 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] MFA Rules not processed for user `b66987c51a2c49a5971da006ace95f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:50.358997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:50.508540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 873/1752] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:50.513827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:50.556016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489185b-501e-48ca-afb7-5c7aaec66577 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:50.582592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:50.583425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.583724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.583966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.586180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:50.586521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:50.591421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:50.620456 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 874/1753] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:50.624756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:50.636594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 880/1754] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:50.638401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9070a-f9b3-46c8-b277-f02776381798 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:50.639876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:50.645002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:50.646225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.646658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.647076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.647983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:50.650170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:50.666260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009135b5-37ef-4800-9bd4-89d194f0cb21 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:50.681958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:50.682689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:50.683025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:50.684227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:50.685154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:50.690930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:50.697601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 875/1755] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/projects => generated 403 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:56:50.710810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:50.769954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 881/1756] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:50.774101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:50.851571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668c20-3ef3-4ab4-b0df-64ea394b3fc7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.014678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bfab9-4e8b-49d0-bf92-9c31fa02d50e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.023548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.024440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.024813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.025230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.026450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.029185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.070530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.074646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.074938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.075383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.076353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.078384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.118381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 882/1757] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/users => generated 289 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:51.128862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 876/1758] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:50 2022] POST /identity/v3/users => generated 302 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:51.129075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.129707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.148682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d9f5-365c-4434-9aaa-cfc20d4c36ed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.155480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d71b3-eb67-4e54-bf29-02a8d0e69c0c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.158935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.158935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.158935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.158935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.159333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.160352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.182343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.184745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.189863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.191141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.193647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 883/1759] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:51.194709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.195951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.204343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.222397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604c5fd-bb9b-4fbe-9524-fe88d74a3b9c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.239023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.240039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.240427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.240773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] PATH_INFO: `/v3/projects/0d4e05e8e5ac4c3d84eabae6321191a3/users/4729b5a5e267478aa24a1140438ab279/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.263195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 877/1760] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:51.267692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.268956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4e05e8e5ac4c3d84eabae6321191a3, user_id=4729b5a5e267478aa24a1140438ab279, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.276081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.306083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28174-91e3-4ee6-b04b-c2e831460564 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.312046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 884/1761] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:51 2022] PUT /identity/v3/projects/0d4e05e8e5ac4c3d84eabae6321191a3/users/4729b5a5e267478aa24a1140438ab279/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:51.313466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.465362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9357b-d3f5-4499-a74d-9ee88cccb237 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.474253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.475113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.475446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.476038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.476930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.478630 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.504710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.507369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.508967 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.511231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.512589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 885/1762] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:51.513413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.513785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.522798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.547986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113dbb-e260-4a3d-9a7a-1b76f626a024 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.555908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 878/1763] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:51.556743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b612369-ab2f-444a-a2e2-6b0f73470a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.557896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b612369-ab2f-444a-a2e2-6b0f73470a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.558326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b612369-ab2f-444a-a2e2-6b0f73470a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.559323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b612369-ab2f-444a-a2e2-6b0f73470a22 admin admin] PATH_INFO: `/v3/projects/0d4e05e8e5ac4c3d84eabae6321191a3/users/4729b5a5e267478aa24a1140438ab279/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.561074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.574289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b612369-ab2f-444a-a2e2-6b0f73470a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4e05e8e5ac4c3d84eabae6321191a3, user_id=4729b5a5e267478aa24a1140438ab279, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.577348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b612369-ab2f-444a-a2e2-6b0f73470a22 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.585155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389a49-e1de-402e-8b7b-ffd5b8fb0ac2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:51.591601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf036f0-0b0b-456c-a8ce-cd374a932d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:51.593099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf036f0-0b0b-456c-a8ce-cd374a932d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.593481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf036f0-0b0b-456c-a8ce-cd374a932d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.594064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf036f0-0b0b-456c-a8ce-cd374a932d06 admin admin] PATH_INFO: `/v3/projects/b26e07bb50144db684bc944ab78e2989/users/acee0b97bf2047e2af3e9932aaa884ac/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.599978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 886/1764] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:51 2022] PUT /identity/v3/projects/0d4e05e8e5ac4c3d84eabae6321191a3/users/4729b5a5e267478aa24a1140438ab279/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:51.611787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.612231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.612674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.613669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf036f0-0b0b-456c-a8ce-cd374a932d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26e07bb50144db684bc944ab78e2989, user_id=acee0b97bf2047e2af3e9932aaa884ac, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:51.617200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf036f0-0b0b-456c-a8ce-cd374a932d06 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:51.646475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 879/1765] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:51 2022] PUT /identity/v3/projects/b26e07bb50144db684bc944ab78e2989/users/acee0b97bf2047e2af3e9932aaa884ac/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:51.659707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:51.660274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:51.660710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:51.696561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] MFA Rules not processed for user `4729b5a5e267478aa24a1140438ab279`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:51.698327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:51.775658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] MFA Rules not processed for user `acee0b97bf2047e2af3e9932aaa884ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:51.780467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:51.905070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 887/1766] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:51.972773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 880/1767] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:51.987449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.987661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:51.989345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:52.161966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129937-1c77-422f-9f5d-080e3e8a267d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.173800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.177620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.180046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.180795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.225000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.232041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.264594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283bab-9a5d-426c-bb76-9a4bbd5d7e1b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.274761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.275775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.276215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.276639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.277544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.279629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.282832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 881/1768] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:52.331651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 888/1769] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:51 2022] POST /identity/v3/projects => generated 405 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:52.336216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:52.355686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ce159-040a-4d2c-aa2f-d72fe50bbd78 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.519135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.519722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.520219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.520498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.521449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.523549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.567591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 882/1770] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:52 2022] POST /identity/v3/users => generated 309 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:52.569772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:52.582673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c0bf-9af7-4fe3-bf54-3a4b381ec58d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.613517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.614231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.614809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.614809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.615535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.617638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.662088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 889/1771] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:52.672485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:52.698888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772dba9-5de2-41b7-b2d1-7cc56245c9aa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.721868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.724948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.726904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.727375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] PATH_INFO: `/v3/projects/acf6e3521e604f2b967a1b46551dcf10/users/61554e17ae544385a6f1d5f550582510/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.774488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf6e3521e604f2b967a1b46551dcf10, user_id=61554e17ae544385a6f1d5f550582510, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.778821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.814809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 883/1772] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:52 2022] PUT /identity/v3/projects/acf6e3521e604f2b967a1b46551dcf10/users/61554e17ae544385a6f1d5f550582510/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:52.817747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:52.834868 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:52.839714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e146-6ab4-47a4-be49-587d3fe9201d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.929004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.929978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.930324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.931258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.931719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.932853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc85b03-4ec0-47b7-b403-70707381fc7b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.933676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.938789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.939877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.940622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.940983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] PATH_INFO: `/v3/users/b66987c51a2c49a5971da006ace95f7b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.942427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66987c51a2c49a5971da006ace95f7b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.944788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:52.950025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 890/1773] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:52.952383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:52.966268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80e61-e870-4d45-a427-1d95daa5f72b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:52.974058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5f19-98cf-4bd3-8c5c-f686b89d9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:52.975858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5f19-98cf-4bd3-8c5c-f686b89d9ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:52.976171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5f19-98cf-4bd3-8c5c-f686b89d9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:52.976441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5f19-98cf-4bd3-8c5c-f686b89d9ccf admin admin] PATH_INFO: `/v3/projects/acf6e3521e604f2b967a1b46551dcf10/users/61554e17ae544385a6f1d5f550582510/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:52.979564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c5f19-98cf-4bd3-8c5c-f686b89d9ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf6e3521e604f2b967a1b46551dcf10, user_id=61554e17ae544385a6f1d5f550582510, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:52.982840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c5f19-98cf-4bd3-8c5c-f686b89d9ccf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:53.008701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 891/1774] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:52 2022] PUT /identity/v3/projects/acf6e3521e604f2b967a1b46551dcf10/users/61554e17ae544385a6f1d5f550582510/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:53.008701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bb9b6-4732-48a1-9712-d168d7790f01 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.008701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bb9b6-4732-48a1-9712-d168d7790f01 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.008701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bb9b6-4732-48a1-9712-d168d7790f01 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.008701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 892/1775] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 02:56:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:53.016070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c41d6-c1d3-4043-ab1d-e6f3d01c5bc0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.016363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c41d6-c1d3-4043-ab1d-e6f3d01c5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.016643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c41d6-c1d3-4043-ab1d-e6f3d01c5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.018020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66987c51a2c49a5971da006ace95f7b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:53.042668 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66987c51a2c49a5971da006ace95f7b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:53.044590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66987c51a2c49a5971da006ace95f7b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:53.057775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66987c51a2c49a5971da006ace95f7b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:53.063993 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0b5c41d6-c1d3-4043-ab1d-e6f3d01c5bc0 None None] MFA Rules not processed for user `61554e17ae544385a6f1d5f550582510`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:53.066027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0b5c41d6-c1d3-4043-ab1d-e6f3d01c5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.077213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-52dfd1df-7479-4aa5-bda3-6c95a441465b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66987c51a2c49a5971da006ace95f7b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:53.087381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 884/1776] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:52 2022] DELETE /identity/v3/users/b66987c51a2c49a5971da006ace95f7b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:53.089184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb9fa-9ff1-4bf2-a0b6-a81a9d1f65b1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.089787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb9fa-9ff1-4bf2-a0b6-a81a9d1f65b1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.090270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb9fa-9ff1-4bf2-a0b6-a81a9d1f65b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.120446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8e4fb9fa-9ff1-4bf2-a0b6-a81a9d1f65b1 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:53.123268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8e4fb9fa-9ff1-4bf2-a0b6-a81a9d1f65b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.160895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 893/1777] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:53.160895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.160895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.160895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.200973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:53.202301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.260014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 885/1778] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:53.261734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f782-b25c-428e-8b35-47237befe8d1 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.262029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f782-b25c-428e-8b35-47237befe8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.262348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f782-b25c-428e-8b35-47237befe8d1 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.264151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 886/1779] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 02:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:56:53.265828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5b94-202c-4229-acf6-2a8c3e9c2c1d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.266111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5b94-202c-4229-acf6-2a8c3e9c2c1d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.266380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5b94-202c-4229-acf6-2a8c3e9c2c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.291470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0e3a5b94-202c-4229-acf6-2a8c3e9c2c1d None None] MFA Rules not processed for user `076a8d1b26864240a8007d2ac7080e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:53.293744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0e3a5b94-202c-4229-acf6-2a8c3e9c2c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.318808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 894/1780] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:53.319770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:53.331088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.392625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a067f21-4cbe-4854-8fc4-159e1f28242f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:53.393746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 887/1781] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:53.395056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.395334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.395606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.397110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:53.397760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.398182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.398512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.415315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:53.417902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.430303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 888/1782] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:53.431220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:53.432538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.447286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76007-b73f-45a5-a3ee-8d364eea21b6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:53.455449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:53.456607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.457050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.457465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.469607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:53.471537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:53.488229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 889/1783] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:53.489189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:53.490585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:53.516827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:53.518462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:53.531435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 895/1784] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:53.563522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866bfe-18d9-4015-a09c-90e3b43f82ee service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:53.567437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:53.568092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.568370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.568644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.578542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:53.580063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:53.584588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:53.591309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 890/1785] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:53.598322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00edd1-1c07-42ab-af05-e94aa3e0a6c3 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:53.604341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:53.605029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:53.605308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:53.605581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:53.616280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:53.617947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:53.636494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 896/1786] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:54.101994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:54.105176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:54.121339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd602-426e-4d80-b21c-45693b295490 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:54.127505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:54.128393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:54.128666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:54.129107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] PATH_INFO: `/v3/projects/204c1fd85bf546caae90db7ef5d7e723` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:54.130464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204c1fd85bf546caae90db7ef5d7e723)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:54.133063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:54.181681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204c1fd85bf546caae90db7ef5d7e723', 'request_id': 'req-79d8a475-b520-4ac0-a335-cabb3b098628'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.191020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204c1fd85bf546caae90db7ef5d7e723', 'request_id': 'req-79d8a475-b520-4ac0-a335-cabb3b098628'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.199343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204c1fd85bf546caae90db7ef5d7e723', 'request_id': 'req-79d8a475-b520-4ac0-a335-cabb3b098628'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.210453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] The token cache is being invalidate because project 204c1fd85bf546caae90db7ef5d7e723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:54.210739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.211412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.212978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 891/1787] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:54 2022] DELETE /identity/v3/projects/204c1fd85bf546caae90db7ef5d7e723 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:54.217191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:54.227648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f41d-3f02-4a98-a85d-6108de4e1d4a service nova] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:54.289394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:54.290074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:54.290332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:54.290592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] PATH_INFO: `/v3/users/4729b5a5e267478aa24a1140438ab279` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:54.291800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4729b5a5e267478aa24a1140438ab279)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:54.293757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:54.373688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4729b5a5e267478aa24a1140438ab279'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.375373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4729b5a5e267478aa24a1140438ab279'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.385966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4729b5a5e267478aa24a1140438ab279'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.403984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4729b5a5e267478aa24a1140438ab279'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.412485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-dcf55e6d-01e0-473d-aa27-f9b39e0141c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4729b5a5e267478aa24a1140438ab279'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.419121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 897/1788] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:54 2022] DELETE /identity/v3/users/4729b5a5e267478aa24a1140438ab279 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:54.721256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:54.723565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:54.742839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a475-b520-4ac0-a335-cabb3b098628 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:54.799622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:54.800494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:54.800796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:54.801068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] PATH_INFO: `/v3/projects/0d4e05e8e5ac4c3d84eabae6321191a3` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:54.802259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4e05e8e5ac4c3d84eabae6321191a3)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:54.804155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:54.850559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4e05e8e5ac4c3d84eabae6321191a3', 'request_id': 'req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.859344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4e05e8e5ac4c3d84eabae6321191a3', 'request_id': 'req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.865511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4e05e8e5ac4c3d84eabae6321191a3', 'request_id': 'req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.876249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] The token cache is being invalidate because project 0d4e05e8e5ac4c3d84eabae6321191a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:54.876539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.877232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5c8f8180-93bc-42d0-aa7b-3a247b83dfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:54.878853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 892/1789] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:54 2022] DELETE /identity/v3/projects/0d4e05e8e5ac4c3d84eabae6321191a3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:54.884635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:54.884972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:54.885251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:54.903125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:54.904322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:54.971680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 898/1790] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:54.980912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:54.984493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:54.985252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.017462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:55.018143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.018793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:55.019522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:55.027332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 893/1791] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:55.031319 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.032779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970b3b-0c51-45c9-93ed-8b63d7fa5cf6 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.038264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.039174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.039450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.039727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] PATH_INFO: `/v3/users/acee0b97bf2047e2af3e9932aaa884ac` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.040939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acee0b97bf2047e2af3e9932aaa884ac)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.041749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e85d0d-e4ab-4288-bc3a-adeec3da29a3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.043014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.047771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.048583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.049004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.049394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.050660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:55.051109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.053067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.067689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 894/1792] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:55.072004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.092548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07fe6-fb49-4f82-b37a-b0a4c6e76f87 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.099270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.100218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.100653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.101112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.101844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.104905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.166372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 895/1793] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:55 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:55.167435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.169813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acee0b97bf2047e2af3e9932aaa884ac'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:55.170767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acee0b97bf2047e2af3e9932aaa884ac'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:55.179303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acee0b97bf2047e2af3e9932aaa884ac'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:55.200046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acee0b97bf2047e2af3e9932aaa884ac'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:55.216126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77c2a030-ce70-40c3-8bcb-c80fceb2f9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acee0b97bf2047e2af3e9932aaa884ac'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:55.228434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 899/1794] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:55 2022] DELETE /identity/v3/users/acee0b97bf2047e2af3e9932aaa884ac => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:55.233486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.233774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.234056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.262143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:55.272635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:55.292512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540132ed-451e-4bd7-b756-50ed5424b4e0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.346602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 900/1795] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:55.356960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.358349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:55.371386 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.372180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.372516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.372909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.373691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.375882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.412660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 896/1796] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:55 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:55.414083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.416428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:55.433136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd28af8-c1d8-49f5-a922-370a8e049bfd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.443980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.445373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.445861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.446447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.447676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.449564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.449699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95549c-0723-4a41-89fd-8da75b1f0427 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.459830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.460850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.461136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.461415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.477254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 897/1797] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:55.477461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.479561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.480017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.508344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b4f71-fdf8-4673-b067-7ac54af0a7fe admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.513047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 901/1798] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:55.533735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64748c56-bd48-46b2-8432-b6c26fae144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.542067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748c56-bd48-46b2-8432-b6c26fae144f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.542067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748c56-bd48-46b2-8432-b6c26fae144f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.542067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748c56-bd48-46b2-8432-b6c26fae144f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.542067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64748c56-bd48-46b2-8432-b6c26fae144f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.555499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64748c56-bd48-46b2-8432-b6c26fae144f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.589174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 898/1799] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:55.593649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:55.617621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850781d-227a-4e10-922e-5808d6c50086 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:55.623980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:55.624974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.625370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.625564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] PATH_INFO: `/v3/projects/adbc006333a6417ab93684c23020a032/users/b15239d3f6b74c8bad29f3c6acf31682/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.669581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbc006333a6417ab93684c23020a032, user_id=b15239d3f6b74c8bad29f3c6acf31682, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:55.678866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:55.709979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 902/1800] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:55 2022] PUT /identity/v3/projects/adbc006333a6417ab93684c23020a032/users/b15239d3f6b74c8bad29f3c6acf31682/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:55.741324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:55.741848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:55.742163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:55.799904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] MFA Rules not processed for user `b15239d3f6b74c8bad29f3c6acf31682`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:55.801204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:55.916656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 899/1801] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:55.920936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.076549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32c1d3-00aa-4fc8-9881-0b9704639179 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.086738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.087427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.087702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.092882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.093702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.096915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.170264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.171900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:56.178268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 903/1802] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:55 2022] POST /identity/v3/projects => generated 363 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:56.179200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.194255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eae1e-5925-44fa-9288-6301c09aa952 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.330736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7fd9a-640f-4aed-91c5-d73f2528737e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.336104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.337055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.337341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.337618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] PATH_INFO: `/v3/projects/b26e07bb50144db684bc944ab78e2989` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.338288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.339261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.339737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.340573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.341459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.342577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26e07bb50144db684bc944ab78e2989)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.343979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.355365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.386410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 904/1803] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:56 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:56.390453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.417264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ec52-ebdf-472d-ba3f-b2bc52d237c0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.426755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.431956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.431956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.431956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.431956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.431956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.459165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 905/1804] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:56.460792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.467222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26e07bb50144db684bc944ab78e2989', 'request_id': 'req-630868c9-8c0a-411f-a038-ff4d269d154c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.474029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44345-71e6-4173-ae30-d9900a1068e4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.491921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26e07bb50144db684bc944ab78e2989', 'request_id': 'req-630868c9-8c0a-411f-a038-ff4d269d154c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.513362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26e07bb50144db684bc944ab78e2989', 'request_id': 'req-630868c9-8c0a-411f-a038-ff4d269d154c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.569458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] The token cache is being invalidate because project b26e07bb50144db684bc944ab78e2989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:56.570894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.572594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.577083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.577287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 900/1805] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:56 2022] DELETE /identity/v3/projects/b26e07bb50144db684bc944ab78e2989 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:56.582112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.583660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.584144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.586090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] PATH_INFO: `/v3/projects/10477c7090c74c929b398cf721aa2a06/users/75689eafedcd417e9537c24a4c7ceea8/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.587321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:56.622709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10477c7090c74c929b398cf721aa2a06, user_id=75689eafedcd417e9537c24a4c7ceea8, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.627676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.641508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630868c9-8c0a-411f-a038-ff4d269d154c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.659827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 906/1806] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:56 2022] PUT /identity/v3/projects/10477c7090c74c929b398cf721aa2a06/users/75689eafedcd417e9537c24a4c7ceea8/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:56.663600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.668138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:56.761709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf994a-db02-493d-a15a-841f03961ad9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.770406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.771532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.771821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.772261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.773459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.775110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.792805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 907/1807] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:56.793755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:56.806551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88541aca-475e-4976-9b61-8a2d4c0e29c0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:56.812092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83d34-5c96-47ee-bb80-75fce73ffe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.813142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83d34-5c96-47ee-bb80-75fce73ffe9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.813438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83d34-5c96-47ee-bb80-75fce73ffe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.813743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83d34-5c96-47ee-bb80-75fce73ffe9f admin admin] PATH_INFO: `/v3/projects/10477c7090c74c929b398cf721aa2a06/users/75689eafedcd417e9537c24a4c7ceea8/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.816429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f83d34-5c96-47ee-bb80-75fce73ffe9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10477c7090c74c929b398cf721aa2a06, user_id=75689eafedcd417e9537c24a4c7ceea8, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.817708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:56.819507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f83d34-5c96-47ee-bb80-75fce73ffe9f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.820147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.820773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.821104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] PATH_INFO: `/v3/users/61554e17ae544385a6f1d5f550582510` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.822776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61554e17ae544385a6f1d5f550582510)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:56.827363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:56.841078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 908/1808] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:56 2022] PUT /identity/v3/projects/10477c7090c74c929b398cf721aa2a06/users/75689eafedcd417e9537c24a4c7ceea8/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:56.854399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:56.854714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:56.854987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:56.901247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] MFA Rules not processed for user `75689eafedcd417e9537c24a4c7ceea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:56.902623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:56.927161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61554e17ae544385a6f1d5f550582510'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.937736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61554e17ae544385a6f1d5f550582510'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.939367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61554e17ae544385a6f1d5f550582510'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.948686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61554e17ae544385a6f1d5f550582510'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.971687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61554e17ae544385a6f1d5f550582510'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:56.978676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 901/1809] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:56 2022] DELETE /identity/v3/users/61554e17ae544385a6f1d5f550582510 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:56.997070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 909/1810] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:57.003459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:57.004995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:57.171090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230880-b09d-4f38-ae97-52b2bb233be3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:57.175952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:57.176500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:57.176840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:57.177014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:57.308522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:57.310404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:57.349001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 902/1811] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:57.460247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:57.512607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:57.514531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:57.603497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6326d-8ddd-40e6-9129-28106d5ab349 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:57.613358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:57.614052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:57.614351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:57.615839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:57.620967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:57.648680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab7884-60cb-4a16-a966-ac26409c3e62 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:57.668686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:57.669601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:57.669902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:57.673434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] PATH_INFO: `/v3/projects/acf6e3521e604f2b967a1b46551dcf10` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:57.676356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf6e3521e604f2b967a1b46551dcf10)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:57.677790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:57.720145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:57.722421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee403b29-2b7e-4b03-83a0-f27cdbc529f3 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:57.752938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 910/1812] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:57.830475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf6e3521e604f2b967a1b46551dcf10', 'request_id': 'req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:57.849965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf6e3521e604f2b967a1b46551dcf10', 'request_id': 'req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:57.860234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf6e3521e604f2b967a1b46551dcf10', 'request_id': 'req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:57.903871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] The token cache is being invalidate because project acf6e3521e604f2b967a1b46551dcf10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:56:57.904443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:57.905625 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b04f6ef8-26ad-4220-9022-55c4fbf2f43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:57.911537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 903/1813] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:57 2022] DELETE /identity/v3/projects/acf6e3521e604f2b967a1b46551dcf10 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:56:57.914055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:57.914055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:57.918777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:57.951213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:57.954860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:58.110986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 911/1814] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:58.122658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.122935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.123234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.143863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:58.145102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:58.154653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 904/1815] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:56:58.159433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.169568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bc285-3b68-4136-9b81-649ad280746e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.174523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.175274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.175547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.175889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.176707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:56:58.177046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.179511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.198431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 912/1816] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:56:58.203011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.212479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4beded-e754-4291-9e5a-d1df7941bfdb None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.217154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.217810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.218087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.218357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.219068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.221175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.255277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 905/1817] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:58 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:56:58.259251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.270453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af46a-f7d5-4b8a-9b8d-151fb5d5eeaf admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.342920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.343539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.343819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.344092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.344969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.347042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.376201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 913/1818] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:58 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:58.378944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.391057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e530d-4802-4340-a758-33e412b7d4e8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.397346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.398027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.398302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.398581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.399317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.400998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.419813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 906/1819] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:58.428997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.432427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9add-e5a8-444e-a463-6783288a9c50 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.437275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f2708-0012-4599-a174-66a5b6696f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.437950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f2708-0012-4599-a174-66a5b6696f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.438211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f2708-0012-4599-a174-66a5b6696f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.438483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f2708-0012-4599-a174-66a5b6696f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.439265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f2708-0012-4599-a174-66a5b6696f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.440895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f2708-0012-4599-a174-66a5b6696f67 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.451084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 914/1820] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:58.455703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.475159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba014f7-94ba-4e3d-9df8-c41b7875d11f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.480341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.481285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.481561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.481884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] PATH_INFO: `/v3/projects/252be43628f749b399c79c0a0c077c6e/users/608e265361374ebe98b479e0b90222ef/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.499956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252be43628f749b399c79c0a0c077c6e, user_id=608e265361374ebe98b479e0b90222ef, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.502735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.519283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 907/1821] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:58 2022] PUT /identity/v3/projects/252be43628f749b399c79c0a0c077c6e/users/608e265361374ebe98b479e0b90222ef/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:58.530439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.531063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.531063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.561211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] MFA Rules not processed for user `608e265361374ebe98b479e0b90222ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:58.562472 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:58.660264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 915/1822] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:58.664935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.756321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d9424-c1d7-4372-aee4-c84dd5fcb1d5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.761169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.761833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.762107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.762555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.763270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.765201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.800261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 908/1823] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:56:58 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:58.805007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.818418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b468-2e06-458e-b694-faaa4e6dbf70 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.878546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.879217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.879548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.879769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.880475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.882621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.917294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.921951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 916/1824] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:56:58 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:56:58.928830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a3a8-6576-45fa-9773-5b0d3b9a3c2c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.930401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.932792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:58.937973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.940042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.941103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.941377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.942149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.943767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.952083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea7a3-4f73-43ed-9344-3b431e024920 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.962192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 909/1825] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:56:58.966455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:58.967679 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.968675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.969102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.969468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] PATH_INFO: `/v3/users/7c997f6c426544f39336dae650d66d60` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:58.970957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c997f6c426544f39336dae650d66d60)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:58.973462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:58.988867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe1f35-cac6-481c-bba2-f55556f7996f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:58.997084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:58.997876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:58.998171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:58.998444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] PATH_INFO: `/v3/projects/4c10c84ab0d748879293ba9f1e8d939e/users/b8ad39ec630f4a4eba9c95c2d924c70c/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.021607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c10c84ab0d748879293ba9f1e8d939e, user_id=b8ad39ec630f4a4eba9c95c2d924c70c, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.024247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:59.048146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c997f6c426544f39336dae650d66d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:59.049541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c997f6c426544f39336dae650d66d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:59.054504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 910/1826] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:58 2022] PUT /identity/v3/projects/4c10c84ab0d748879293ba9f1e8d939e/users/b8ad39ec630f4a4eba9c95c2d924c70c/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:59.061713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:59.064473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c997f6c426544f39336dae650d66d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:59.103230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c997f6c426544f39336dae650d66d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:59.123550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6fb1bf55-0cca-4e2a-ae08-d0ad22e9c56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c997f6c426544f39336dae650d66d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:56:59.135929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 917/1827] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:56:58 2022] DELETE /identity/v3/users/7c997f6c426544f39336dae650d66d60 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:59.141741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.142140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.142538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.181431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:59.182804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.213857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51987c-3c58-41f0-9ff9-a5762a90bb89 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:59.306311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 918/1828] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:59.317259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:59.318855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.362395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:59.364869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.365030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.365541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.367930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.373833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:59.402200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 911/1829] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:56:59.402200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:59.403661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.424096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f75db-41e5-40e0-8d3e-0cc984222aaa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:59.430329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45ef1a-64de-4ee3-a797-31cdf0d6427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:59.432248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45ef1a-64de-4ee3-a797-31cdf0d6427d admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.432581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45ef1a-64de-4ee3-a797-31cdf0d6427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.433802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45ef1a-64de-4ee3-a797-31cdf0d6427d admin admin] PATH_INFO: `/v3/projects/4c10c84ab0d748879293ba9f1e8d939e/users/b8ad39ec630f4a4eba9c95c2d924c70c/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.436149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45ef1a-64de-4ee3-a797-31cdf0d6427d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c10c84ab0d748879293ba9f1e8d939e, user_id=b8ad39ec630f4a4eba9c95c2d924c70c, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.447271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45ef1a-64de-4ee3-a797-31cdf0d6427d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:59.449391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf4e10-dce2-401c-b8b9-de07a7a42d7f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:59.456324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 912/1830] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:56:59 2022] PUT /identity/v3/projects/4c10c84ab0d748879293ba9f1e8d939e/users/b8ad39ec630f4a4eba9c95c2d924c70c/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:56:59.468671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.469000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.469438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.500624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] MFA Rules not processed for user `b8ad39ec630f4a4eba9c95c2d924c70c`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:56:59.502388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.530508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:59.531204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.531584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.531905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.608314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 913/1831] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:56:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:56:59.623851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.624412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:59.625480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:59.626102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.637919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 919/1832] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:59.777143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b5418-4266-4989-9518-6a4917510c8e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:59.783711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:59.793682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.794209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.794952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.811470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.813801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:59.825147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 914/1833] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:56:59.871180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:59.872611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.884751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c3e5-686d-43c8-8940-4bc9a9678b08 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:59.888638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:59.889280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.889577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.889845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.891673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.938515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:56:59.939959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:56:59.960132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.961698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:56:59.963499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17f74f-a640-4e62-a7ad-d66f3b708230 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:56:59.968470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:56:59.970568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:56:59.971010 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:56:59.978503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 920/1834] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:56:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:56:59.981296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] PATH_INFO: `/v3/projects/4d076b76f0d14a75a5a71132398e2df1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:56:59.982684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d076b76f0d14a75a5a71132398e2df1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:56:59.984602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:00.032547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d076b76f0d14a75a5a71132398e2df1', 'request_id': 'req-de273b60-8514-40aa-b400-b43a0b75649a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.040166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d076b76f0d14a75a5a71132398e2df1', 'request_id': 'req-de273b60-8514-40aa-b400-b43a0b75649a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.046605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d076b76f0d14a75a5a71132398e2df1', 'request_id': 'req-de273b60-8514-40aa-b400-b43a0b75649a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.057376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] The token cache is being invalidate because project 4d076b76f0d14a75a5a71132398e2df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:00.057660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.058351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.060000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 915/1835] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:56:59 2022] DELETE /identity/v3/projects/4d076b76f0d14a75a5a71132398e2df1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:00.064288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:00.074996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66b361-3b40-4da8-af62-94245be429d4 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:00.144940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:00.145697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:00.145998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:00.146272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] PATH_INFO: `/v3/users/636fb698c6744b21be963f56176e11c3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:00.149750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=636fb698c6744b21be963f56176e11c3)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:00.151894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:00.208529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636fb698c6744b21be963f56176e11c3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.209650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636fb698c6744b21be963f56176e11c3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.230175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636fb698c6744b21be963f56176e11c3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.244203 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636fb698c6744b21be963f56176e11c3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.257250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636fb698c6744b21be963f56176e11c3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.268390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 921/1836] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:00 2022] DELETE /identity/v3/users/636fb698c6744b21be963f56176e11c3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:00.813341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:00.815520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:00.831551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de273b60-8514-40aa-b400-b43a0b75649a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:00.893935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:00.895363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:00.895791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:00.896206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] PATH_INFO: `/v3/users/b15239d3f6b74c8bad29f3c6acf31682` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:00.897730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15239d3f6b74c8bad29f3c6acf31682)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:00.900540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:00.973791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15239d3f6b74c8bad29f3c6acf31682'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.988015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15239d3f6b74c8bad29f3c6acf31682'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:00.989720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15239d3f6b74c8bad29f3c6acf31682'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.028477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15239d3f6b74c8bad29f3c6acf31682'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.054938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:01.057187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d8e2ff5a-5580-4998-a2fd-7664fc64e619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15239d3f6b74c8bad29f3c6acf31682'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.057336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:01.065061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 916/1837] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:00 2022] DELETE /identity/v3/users/b15239d3f6b74c8bad29f3c6acf31682 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:01.072964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.072964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.072964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.089047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307be6aa-d61d-4ca7-a3d9-949b4a5313bf admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:01.109796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:01.112703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:01.232110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 917/1838] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:01.246417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:01.247314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.247585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.247937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] PATH_INFO: `/v3/projects/ac1cb3a176f5462c9709700a9aeb3a8c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.249657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:01.249986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1cb3a176f5462c9709700a9aeb3a8c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:01.251678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:01.252535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:01.351229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1cb3a176f5462c9709700a9aeb3a8c', 'request_id': 'req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.363866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1cb3a176f5462c9709700a9aeb3a8c', 'request_id': 'req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.390616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1cb3a176f5462c9709700a9aeb3a8c', 'request_id': 'req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.417642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] The token cache is being invalidate because project ac1cb3a176f5462c9709700a9aeb3a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:01.417937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.418649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ec955bd7-1fd7-4a97-94c5-9afa9f1ebb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:01.420469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 922/1839] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:01 2022] DELETE /identity/v3/projects/ac1cb3a176f5462c9709700a9aeb3a8c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:01.426436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737769-6b38-407a-91d9-9326387692dd None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.426731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737769-6b38-407a-91d9-9326387692dd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.427013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737769-6b38-407a-91d9-9326387692dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.435547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487945f-7983-4fdb-b7d1-b4eaba243362 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:01.447942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-bb737769-6b38-407a-91d9-9326387692dd None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:01.448527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-bb737769-6b38-407a-91d9-9326387692dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:01.551512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:01.552229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.552522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.552882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.556670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 923/1840] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:01.558325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.558741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.559586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.565245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:01.604851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:01.607641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:01.610813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:01.612005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:01.633143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 918/1841] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:01.633439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 924/1842] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:01.638477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:01.655362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814b48-628d-4bee-b692-9ad5d7321154 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:01.665476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:01.666136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.666407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.666817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.667738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:01.668860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:01.670888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:01.687989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 919/1843] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:01.692404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:01.706533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0e696-eec4-4277-a02c-b634f348c440 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:01.711742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:01.712530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.713231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.713231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.713954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:01.716670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:01.752610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 925/1844] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:01 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:01.758659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:01.773212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3ae85-4f79-47fb-84d6-9bc8ec3d7e29 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:01.872759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:01.874993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.875390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.875757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.878023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:01.879985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:01.920846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:01.931156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 920/1845] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:01 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:01.934574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7ceea-11d8-4249-af5f-264b8d115c66 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:01.955582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:01.956625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:01.957323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:01.958006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:01.958550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:01.960266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:01.974597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 926/1846] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:01.978581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.017629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05342a8-d18d-4f23-8af1-9d1f73817e38 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.026488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1493-b62f-48fb-bce9-a52d480cb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.027631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1493-b62f-48fb-bce9-a52d480cb8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.028172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1493-b62f-48fb-bce9-a52d480cb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.028775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1493-b62f-48fb-bce9-a52d480cb8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.029981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1493-b62f-48fb-bce9-a52d480cb8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.032598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1493-b62f-48fb-bce9-a52d480cb8aa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.052767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 921/1847] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:02.054549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.072680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdd9f-e6e2-4741-8341-f95c3e0ff6aa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.077675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.078777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.079254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.079696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] PATH_INFO: `/v3/projects/c4a74438ec854d5d9201bd985d88f61f/users/38278a6485ee40c6a3a2bf81fb328c1b/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.098499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a74438ec854d5d9201bd985d88f61f, user_id=38278a6485ee40c6a3a2bf81fb328c1b, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.102838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.126065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 927/1848] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:02 2022] PUT /identity/v3/projects/c4a74438ec854d5d9201bd985d88f61f/users/38278a6485ee40c6a3a2bf81fb328c1b/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:02.137213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.137552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.138210 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.179093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] MFA Rules not processed for user `38278a6485ee40c6a3a2bf81fb328c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:02.180902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:02.263788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 922/1849] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:02.268169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.358415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b4d0a-6759-4e81-8d13-3b3e7e0514d5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.365860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.366829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.367212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.367565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.368920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.371291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.427893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 928/1850] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:02 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:02.432574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.450604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b070e54-a886-453b-ad25-f6946bd8fa38 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.531489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.532606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.533122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.533768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.534695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.537947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.565133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 923/1851] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:02 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:02.569241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.589523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adef4-1fb0-4863-8add-559f8a55393e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.599871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.601696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.602726 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.604634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.606008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.608232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.630373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 929/1852] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:02.634627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.645306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f432-5e42-4161-baef-d1fd428dfcd0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.652212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.652212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.652212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.652212 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] PATH_INFO: `/v3/projects/3b07ebdd00bd4c2e81104ac4393f7934/users/1ccea315acfa4113a790e3c13dea8105/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.689865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b07ebdd00bd4c2e81104ac4393f7934, user_id=1ccea315acfa4113a790e3c13dea8105, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.692951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.736790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 924/1853] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:02 2022] PUT /identity/v3/projects/3b07ebdd00bd4c2e81104ac4393f7934/users/1ccea315acfa4113a790e3c13dea8105/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:02.744611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.763747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff14f-fae7-4f9c-b8b1-e0f8eddb65e2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.894978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a446c4-e85c-443a-b388-d5ceb168d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.897533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a446c4-e85c-443a-b388-d5ceb168d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.900398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a446c4-e85c-443a-b388-d5ceb168d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.900865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a446c4-e85c-443a-b388-d5ceb168d9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.901809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a446c4-e85c-443a-b388-d5ceb168d9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.904254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a446c4-e85c-443a-b388-d5ceb168d9b3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:02.932036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 930/1854] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:02.936072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:02.966546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39877a25-1229-41e9-b13b-0e38565d855d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:02.972596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:02.974289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:02.974289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:02.974591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] PATH_INFO: `/v3/projects/3b07ebdd00bd4c2e81104ac4393f7934/users/1ccea315acfa4113a790e3c13dea8105/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:02.977041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b07ebdd00bd4c2e81104ac4393f7934, user_id=1ccea315acfa4113a790e3c13dea8105, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:02.981479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:03.005016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 925/1855] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:02 2022] PUT /identity/v3/projects/3b07ebdd00bd4c2e81104ac4393f7934/users/1ccea315acfa4113a790e3c13dea8105/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:03.009534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:03.010013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:03.010422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:03.039652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:03.045793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:03.081821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] MFA Rules not processed for user `1ccea315acfa4113a790e3c13dea8105`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:03.088773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:03.139243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e2fe-77f7-4b01-a703-c392662d388d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:03.146185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:03.147216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:03.147497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:03.148807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] PATH_INFO: `/v3/projects/adbc006333a6417ab93684c23020a032` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:03.150182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbc006333a6417ab93684c23020a032)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:03.152323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:03.229286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbc006333a6417ab93684c23020a032', 'request_id': 'req-922816de-cea4-4a53-851f-370f043232f6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.243834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbc006333a6417ab93684c23020a032', 'request_id': 'req-922816de-cea4-4a53-851f-370f043232f6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.254792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbc006333a6417ab93684c23020a032', 'request_id': 'req-922816de-cea4-4a53-851f-370f043232f6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.264972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 931/1856] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:03.278460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:03.280799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:03.285173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] The token cache is being invalidate because project adbc006333a6417ab93684c23020a032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:03.285380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.287088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.291377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 926/1857] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:03 2022] DELETE /identity/v3/projects/adbc006333a6417ab93684c23020a032 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:03.292446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:03.294637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:03.417325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ff93-9581-4735-9104-3bea2cc9de76 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:03.430114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922816de-cea4-4a53-851f-370f043232f6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:03.435147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:03.436175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:03.436565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:03.437085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] PATH_INFO: `/v3/users/75689eafedcd417e9537c24a4c7ceea8` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:03.438954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75689eafedcd417e9537c24a4c7ceea8)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:03.442650 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:03.487807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:03.488526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:03.488914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:03.489128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:03.491448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:03.547061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75689eafedcd417e9537c24a4c7ceea8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.563944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75689eafedcd417e9537c24a4c7ceea8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.564857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75689eafedcd417e9537c24a4c7ceea8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.576572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75689eafedcd417e9537c24a4c7ceea8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.629662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75689eafedcd417e9537c24a4c7ceea8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:03.648549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 927/1858] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:03 2022] DELETE /identity/v3/users/75689eafedcd417e9537c24a4c7ceea8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:03.651396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:03.653064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0a1a1-4935-42a9-8295-331b4b8a950b service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:03.669143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 932/1859] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:03.841469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:03.843312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:03.933970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dab81-c44b-4f3e-a25b-67dd515b4742 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:03.939408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:03.940567 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:03.940889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:03.941185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] PATH_INFO: `/v3/users/608e265361374ebe98b479e0b90222ef` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:03.942572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608e265361374ebe98b479e0b90222ef)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:03.944548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.000551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608e265361374ebe98b479e0b90222ef'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.022519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608e265361374ebe98b479e0b90222ef'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.023138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608e265361374ebe98b479e0b90222ef'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.034817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608e265361374ebe98b479e0b90222ef'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.066827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608e265361374ebe98b479e0b90222ef'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.092443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 928/1860] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:03 2022] DELETE /identity/v3/users/608e265361374ebe98b479e0b90222ef => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:04.097504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.097988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.098086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.125362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:04.127957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.236381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.238492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.252189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 933/1861] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:04.269321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad835813-b36c-4e26-85b7-89ae60104ff8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.271020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.274644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.289455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.290270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.290552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.291046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] PATH_INFO: `/v3/projects/10477c7090c74c929b398cf721aa2a06` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.292775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10477c7090c74c929b398cf721aa2a06)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.295437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.378966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10477c7090c74c929b398cf721aa2a06', 'request_id': 'req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.386613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf9ae-d43c-440a-b62e-32cc3d4cc40d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.394552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10477c7090c74c929b398cf721aa2a06', 'request_id': 'req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.409451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10477c7090c74c929b398cf721aa2a06', 'request_id': 'req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.421971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] The token cache is being invalidate because project 10477c7090c74c929b398cf721aa2a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:04.422250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.422970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eab2d3ce-46e4-42a9-bd47-d547cdbe879b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.425994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 929/1862] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:04 2022] DELETE /identity/v3/projects/10477c7090c74c929b398cf721aa2a06 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:04.432077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.433205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.433687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.460867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:04.462570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.470570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.471345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.471725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.472083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.478613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.558059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 930/1863] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:04.560578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.563551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.567227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.569254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf6cd-dc76-4f4b-8119-98a431b7892b service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.576176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf34599-8f74-4c31-b119-e2c8e10aae58 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.580496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 934/1864] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:04.582365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.582686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.583210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.593539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.594454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.596876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.597196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] PATH_INFO: `/v3/users/38278a6485ee40c6a3a2bf81fb328c1b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.605629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=38278a6485ee40c6a3a2bf81fb328c1b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.606215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:04.607507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.607608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.615852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 935/1865] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:04.619920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.629693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ef39-78af-4e66-8d05-bb599ee4c420 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.634714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.635539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.635848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.636125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.636954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:04.637284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.638970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.659419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 936/1866] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:04.661120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.673709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f39274-cc90-41bd-bfd0-c2329245f74f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.677925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38278a6485ee40c6a3a2bf81fb328c1b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.680262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.681041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.681565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.681936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.682733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.685096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.691108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38278a6485ee40c6a3a2bf81fb328c1b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.691900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38278a6485ee40c6a3a2bf81fb328c1b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.703564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38278a6485ee40c6a3a2bf81fb328c1b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.720117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 937/1867] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:04 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:04.721238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.721827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-487e9c8c-28d6-4608-b985-d9e6b64fc5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38278a6485ee40c6a3a2bf81fb328c1b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:04.730869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 931/1868] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:04 2022] DELETE /identity/v3/users/38278a6485ee40c6a3a2bf81fb328c1b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:04.735708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.736028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.736150 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.755654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:04.757484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.799353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf37679-f995-429e-985b-29ce5cf733ee admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.849038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 932/1869] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:04.863324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.864413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.865196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.865413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.865559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.865976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.866801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.868868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.892112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 938/1870] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:04 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:04.903063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.906854 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:04.921221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56066f27-52e7-49bf-bb65-df6df9d9c7ed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.926294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.927631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.927631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.927847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.928620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.930326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.946792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3c29-be69-4a01-9eee-d888a4859ad3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.952443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 939/1871] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:04.952583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.952583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.952583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.952583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.953526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:04.963771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3c090-bdaf-469f-a1c9-c837987f1d4c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:04.964066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.965772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.969440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478b048-5240-463b-9bce-c734bff6a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:04.970288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b048-5240-463b-9bce-c734bff6a56e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:04.970512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b048-5240-463b-9bce-c734bff6a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:04.970781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b048-5240-463b-9bce-c734bff6a56e admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:04.971706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478b048-5240-463b-9bce-c734bff6a56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:04.973148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478b048-5240-463b-9bce-c734bff6a56e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:04.977021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 933/1872] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:04.987092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 940/1873] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:04.991680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.002313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d17c56-21b0-46d6-b14e-f178f53ed5c4 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.009773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.010674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.010947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.011216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] PATH_INFO: `/v3/projects/fed92431de1b47a68ea6f1e470972139/users/bdc46081236f412398632ee27ddc831f/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.027631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed92431de1b47a68ea6f1e470972139, user_id=bdc46081236f412398632ee27ddc831f, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.030349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.065092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 934/1874] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:04 2022] PUT /identity/v3/projects/fed92431de1b47a68ea6f1e470972139/users/bdc46081236f412398632ee27ddc831f/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:05.066909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.067260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.067542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.110550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] MFA Rules not processed for user `bdc46081236f412398632ee27ddc831f`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:05.112968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.114829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.121852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.220974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 941/1875] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:05.224983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.255851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc0a8-ae62-47f8-b32a-c6507de0ff87 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.265842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.268045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.268321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.271570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] PATH_INFO: `/v3/projects/252be43628f749b399c79c0a0c077c6e` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.271570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252be43628f749b399c79c0a0c077c6e)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.273653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.299035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a23d-c4c7-48bc-a11a-c3caf15b772c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.304806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.305879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.306155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.306427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.307131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.310027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.331911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252be43628f749b399c79c0a0c077c6e', 'request_id': 'req-5762b3f4-01e2-4193-8431-48f88c593f98'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.339469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 942/1876] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:05 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:05.343022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252be43628f749b399c79c0a0c077c6e', 'request_id': 'req-5762b3f4-01e2-4193-8431-48f88c593f98'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.343464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.349760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252be43628f749b399c79c0a0c077c6e', 'request_id': 'req-5762b3f4-01e2-4193-8431-48f88c593f98'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.360410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] The token cache is being invalidate because project 252be43628f749b399c79c0a0c077c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:05.360844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.361605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.364803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 935/1877] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:05 2022] DELETE /identity/v3/projects/252be43628f749b399c79c0a0c077c6e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:05.367602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.369014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.438775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d9d3-f16d-49c9-9dc5-b09a2577051f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.439633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b3f4-01e2-4193-8431-48f88c593f98 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.443527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.444276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.444404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.444643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.444946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.445179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.445453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.445650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.445740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] PATH_INFO: `/v3/users/b8ad39ec630f4a4eba9c95c2d924c70c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.446876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ad39ec630f4a4eba9c95c2d924c70c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.447759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.448792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.468807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 943/1878] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:05 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:05.469930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.471523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.485185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1fa8b-3f79-4e98-9538-b94cec95dab8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.489973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.490845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.491284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.491416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] PATH_INFO: `/v3/projects/c4a74438ec854d5d9201bd985d88f61f` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.492530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a74438ec854d5d9201bd985d88f61f)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.494454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.495685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ad39ec630f4a4eba9c95c2d924c70c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.503282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ad39ec630f4a4eba9c95c2d924c70c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.503920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ad39ec630f4a4eba9c95c2d924c70c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.510879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ad39ec630f4a4eba9c95c2d924c70c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.522102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ad39ec630f4a4eba9c95c2d924c70c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.528390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 936/1879] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:05 2022] DELETE /identity/v3/users/b8ad39ec630f4a4eba9c95c2d924c70c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:05.529540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.530892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.547716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a74438ec854d5d9201bd985d88f61f', 'request_id': 'req-564f114a-9901-4bae-ba34-b66ae934e16d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.554521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a74438ec854d5d9201bd985d88f61f', 'request_id': 'req-564f114a-9901-4bae-ba34-b66ae934e16d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.561206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a74438ec854d5d9201bd985d88f61f', 'request_id': 'req-564f114a-9901-4bae-ba34-b66ae934e16d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.581535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] The token cache is being invalidate because project c4a74438ec854d5d9201bd985d88f61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:05.582086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.583696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.586306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 944/1880] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:05 2022] DELETE /identity/v3/projects/c4a74438ec854d5d9201bd985d88f61f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:05.591582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.595081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.606414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ddcc2-c63e-4d4c-9333-eebf59fdb70f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.666192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.666966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.667080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f114a-9901-4bae-ba34-b66ae934e16d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.667329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.667710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.668653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.672389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.673378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.674266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.674539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.674900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] PATH_INFO: `/v3/users/1ccea315acfa4113a790e3c13dea8105` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.676139 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccea315acfa4113a790e3c13dea8105)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.678235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.682197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 937/1881] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:05.686091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.687908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.701135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48d59-a7b2-4e39-a0e7-f09b615562ef admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.706007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.706901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.707184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.707454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] PATH_INFO: `/v3/projects/c58d93173c4542c29e1be2165bd20258/users/9ec6a6f434c642e1b51868a11de8ab17/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.723696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58d93173c4542c29e1be2165bd20258, user_id=9ec6a6f434c642e1b51868a11de8ab17, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.726476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.738048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccea315acfa4113a790e3c13dea8105'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.738799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccea315acfa4113a790e3c13dea8105'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.743149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 938/1882] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:05 2022] PUT /identity/v3/projects/c58d93173c4542c29e1be2165bd20258/users/9ec6a6f434c642e1b51868a11de8ab17/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:05.746638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.748597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccea315acfa4113a790e3c13dea8105'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.760115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccea315acfa4113a790e3c13dea8105'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.768279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccea315acfa4113a790e3c13dea8105'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.774563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 945/1883] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:05 2022] DELETE /identity/v3/users/1ccea315acfa4113a790e3c13dea8105 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:05.811520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.813043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.833220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b406-a3b3-4698-b78d-1eb86c884b6a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.893862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2a386-1210-4fd3-8247-f0bc7b02c710 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.896894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.897893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.898346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.898883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.899305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.899999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.900172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.900456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.900739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] PATH_INFO: `/v3/projects/4c10c84ab0d748879293ba9f1e8d939e` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.901959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c10c84ab0d748879293ba9f1e8d939e)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.902590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.903866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.918953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 939/1884] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:05.920959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:05.923503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:05.942598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f365a-4ac2-4928-bb41-d140b9eac89f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:05.950040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11b882-a04e-4cef-b5de-b7240dd1760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:05.951107 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11b882-a04e-4cef-b5de-b7240dd1760f admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:05.951480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11b882-a04e-4cef-b5de-b7240dd1760f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:05.951845 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11b882-a04e-4cef-b5de-b7240dd1760f admin admin] PATH_INFO: `/v3/projects/c58d93173c4542c29e1be2165bd20258/users/9ec6a6f434c642e1b51868a11de8ab17/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:05.956896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11b882-a04e-4cef-b5de-b7240dd1760f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58d93173c4542c29e1be2165bd20258, user_id=9ec6a6f434c642e1b51868a11de8ab17, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:05.959821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11b882-a04e-4cef-b5de-b7240dd1760f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:05.966539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c10c84ab0d748879293ba9f1e8d939e', 'request_id': 'req-86ca91bc-cd62-4673-a63f-29260b63cc6d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.975282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c10c84ab0d748879293ba9f1e8d939e', 'request_id': 'req-86ca91bc-cd62-4673-a63f-29260b63cc6d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.981748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c10c84ab0d748879293ba9f1e8d939e', 'request_id': 'req-86ca91bc-cd62-4673-a63f-29260b63cc6d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:05.988651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 940/1885] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:05 2022] PUT /identity/v3/projects/c58d93173c4542c29e1be2165bd20258/users/9ec6a6f434c642e1b51868a11de8ab17/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:05.999886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.000254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.000598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.019048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] The token cache is being invalidate because project 4c10c84ab0d748879293ba9f1e8d939e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:06.019407 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.021203 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86ca91bc-cd62-4673-a63f-29260b63cc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.027401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 946/1886] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:05 2022] DELETE /identity/v3/projects/4c10c84ab0d748879293ba9f1e8d939e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:06.030589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ed4c-2e6f-42fb-a6cb-88e93f3626f0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.030951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ed4c-2e6f-42fb-a6cb-88e93f3626f0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.031344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ed4c-2e6f-42fb-a6cb-88e93f3626f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.041485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] MFA Rules not processed for user `9ec6a6f434c642e1b51868a11de8ab17`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:06.043340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.054409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c3d0ed4c-2e6f-42fb-a6cb-88e93f3626f0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:06.055628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c3d0ed4c-2e6f-42fb-a6cb-88e93f3626f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.151400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 947/1887] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:06.162503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.163004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.163361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.181745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 941/1888] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:06.194844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.199827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.201116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:06.202613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.214318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 948/1889] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:06.221205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.229953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.261187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6258e-75e2-4f56-9ea4-e6e5e64d6a9e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.271196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.272044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.272333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.272606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] PATH_INFO: `/v3/projects/3b07ebdd00bd4c2e81104ac4393f7934` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.275922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b07ebdd00bd4c2e81104ac4393f7934)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.294043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.346253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185eb3f-fb9f-45fa-b643-727991e421fd None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.369629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b07ebdd00bd4c2e81104ac4393f7934', 'request_id': 'req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.381502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b07ebdd00bd4c2e81104ac4393f7934', 'request_id': 'req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.391119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b07ebdd00bd4c2e81104ac4393f7934', 'request_id': 'req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.417957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] The token cache is being invalidate because project 3b07ebdd00bd4c2e81104ac4393f7934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:06.418255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.418992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:06.428705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 949/1890] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:06 2022] DELETE /identity/v3/projects/3b07ebdd00bd4c2e81104ac4393f7934 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:06.429640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.433735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.435947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.437697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.438275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.438647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.440590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.521508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb8672-ddf2-4f21-85fe-44e56df5c8df admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.527671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.528487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.528820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.529105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.529867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:06.530304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.531881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8a61-d3f0-4131-8113-ed0befe5a66b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.551824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.553537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.560928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 950/1891] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:06.562430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d33e5-beb3-4e40-916c-9118c7fe895a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.562718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d33e5-beb3-4e40-916c-9118c7fe895a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.563966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d33e5-beb3-4e40-916c-9118c7fe895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.566290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 942/1892] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:06.567360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.580478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35aaf-be0b-4f21-a04c-107955ab818d service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.586108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.587064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.587339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.587981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.598153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.602494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.619462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c59d33e5-beb3-4e40-916c-9118c7fe895a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:06.625741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c59d33e5-beb3-4e40-916c-9118c7fe895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.640450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 943/1893] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:06.644691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.656240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 951/1894] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:06.657879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.658755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.659108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.695238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:06.697887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:06.757778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2c99-fdb7-4d82-b9ad-2b958004551a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.764054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.764957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.765197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.765504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.766448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.768619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.770366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 952/1895] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:06.775296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.785584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a993-5d82-4499-bd93-8e8d55ff30c7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.792243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.795687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.795840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 944/1896] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:06.795940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.795940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.795940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:06.795940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.796597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.797575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.810973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232cbe-f75b-4a49-8d82-5ccd6d156435 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.816306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 953/1897] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:06.817248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.818924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.819794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.820176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.820545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.821446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.824292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.827986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4b195-ea2f-45cb-a9f3-9b5e847b242f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.835543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.836215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.836494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.836974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.840639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.840639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.841447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 945/1898] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:06.842648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.853635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a9c9-a308-4627-b908-699e08b74a54 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.859686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.860697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.861050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.861464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.862127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.864226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:06.877660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 946/1899] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:06.882112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.887466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 954/1900] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:06.888503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:06.898368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425329e-9317-425e-9944-f993b9ff99af admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.976893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf48b95-46de-447c-8bab-35b90d69d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.979083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48b95-46de-447c-8bab-35b90d69d1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.979850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48b95-46de-447c-8bab-35b90d69d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.980216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48b95-46de-447c-8bab-35b90d69d1f9 admin admin] PATH_INFO: `/v3/projects/fff506d6e93a43f39e7c289edcc4a1c4/users/13d6f98e71bf4b60876845785840443a/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.985431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c367c-af6c-4afc-97c5-3e8ec14e69ad admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:06.992443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:06.993179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:06.993466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:06.993742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:06.994465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:06.996759 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.009993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf48b95-46de-447c-8bab-35b90d69d1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff506d6e93a43f39e7c289edcc4a1c4, user_id=13d6f98e71bf4b60876845785840443a, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.013122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf48b95-46de-447c-8bab-35b90d69d1f9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.019740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 955/1901] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:06 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:07.023691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.037209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694fdac-289e-4982-a5ea-10e2899fcc59 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.043632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 947/1902] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:06 2022] PUT /identity/v3/projects/fff506d6e93a43f39e7c289edcc4a1c4/users/13d6f98e71bf4b60876845785840443a/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:07.056096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.057070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.058730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.091879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] MFA Rules not processed for user `13d6f98e71bf4b60876845785840443a`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:07.093216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.114896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.115574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.115888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.116160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.116983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.118718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.133018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 956/1903] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:07.133723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.143656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911782-35cd-46c5-a466-02188464346e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.148417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.149129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.149410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.149682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.150551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.152305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.158611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 948/1904] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:07.163151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 957/1905] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:07.166917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.172300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.174414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.180267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe3828-86aa-4c82-87b0-d7a4366ff958 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.186998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81f2fc-53b7-4de5-a3b6-6263ebab47b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.187908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81f2fc-53b7-4de5-a3b6-6263ebab47b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.188229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81f2fc-53b7-4de5-a3b6-6263ebab47b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.188505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81f2fc-53b7-4de5-a3b6-6263ebab47b1 admin admin] PATH_INFO: `/v3/projects/541ea1ef008340c1958113a42d887b16/users/376c2cd288904799ae5038483f582000/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.204605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81f2fc-53b7-4de5-a3b6-6263ebab47b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541ea1ef008340c1958113a42d887b16, user_id=376c2cd288904799ae5038483f582000, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.207447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81f2fc-53b7-4de5-a3b6-6263ebab47b1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.222908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 949/1906] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:07 2022] PUT /identity/v3/projects/541ea1ef008340c1958113a42d887b16/users/376c2cd288904799ae5038483f582000/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:07.234973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.235378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.235653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.237438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cace5-2314-4051-b0d8-f79b78049770 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.268372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] MFA Rules not processed for user `376c2cd288904799ae5038483f582000`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:07.269617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.339894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.340608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.342692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.343128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.366485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 950/1907] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:07.371113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.430360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.432691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.456904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 958/1908] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:07.466745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253b7c2-bd3b-4dee-b2e9-57a6ce1b12ea None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.473660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.474609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.475066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.475515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.476581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.476867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.479780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.489541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d3e-ad1a-4eb8-8f70-3ce4511d7c70 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.497392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.499482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.499482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.499482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] PATH_INFO: `/v3/users/13d6f98e71bf4b60876845785840443a` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.500234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d6f98e71bf4b60876845785840443a)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.502805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.524002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 951/1909] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:07.524942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.554588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d6f98e71bf4b60876845785840443a'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:07.555656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d6f98e71bf4b60876845785840443a'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:07.563525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d6f98e71bf4b60876845785840443a'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:07.576340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d6f98e71bf4b60876845785840443a'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:07.584083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ded141c3-d83c-40dc-afb4-2202acc08731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d6f98e71bf4b60876845785840443a'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:07.591638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 959/1910] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:07 2022] DELETE /identity/v3/users/13d6f98e71bf4b60876845785840443a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:07.598563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8421-1c43-43aa-b3b7-22b64c2718a1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.600163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.600451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.601083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.624337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:07.625850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.677996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.678627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.678987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.679243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.680114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.682108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.693872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 960/1911] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:07.709578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.711060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.713380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 952/1912] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:07.714466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.716153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.729948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532f58-a137-4467-834e-69e07e04f6e1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.735804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.736479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.736771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.737177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.737806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.740510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.750892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 953/1913] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:07.754599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.767113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db91d3-5cbb-4d2d-bf5b-24f4f68a3743 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.782527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.782527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.782527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.782527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.782974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.782974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.783571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a366cc1-6c32-4d4b-8a73-0092f3f6d50c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.787797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed26e1-7cd9-4f15-94b2-990567549be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.788674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed26e1-7cd9-4f15-94b2-990567549be6 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.789079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed26e1-7cd9-4f15-94b2-990567549be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.789447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed26e1-7cd9-4f15-94b2-990567549be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.795526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 954/1914] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:07.799735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed26e1-7cd9-4f15-94b2-990567549be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.799958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:07.802253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed26e1-7cd9-4f15-94b2-990567549be6 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.810556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84806-ea63-4c7f-8a52-7442df789e48 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:07.812533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 961/1915] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:07.815341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:07.816413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.816700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.817005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] PATH_INFO: `/v3/projects/e81e4bf534394f9cab3473e5cd52a60b/users/ca6e0c35dd97498298460e396324fe60/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.832139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81e4bf534394f9cab3473e5cd52a60b, user_id=ca6e0c35dd97498298460e396324fe60, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:07.834803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:07.848253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 955/1916] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:07 2022] PUT /identity/v3/projects/e81e4bf534394f9cab3473e5cd52a60b/users/ca6e0c35dd97498298460e396324fe60/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:07.860021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:07.860319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:07.860599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:07.887232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] MFA Rules not processed for user `ca6e0c35dd97498298460e396324fe60`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:07.888444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:07.962588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 962/1917] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:07.967068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.032648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f322d4f-2624-4214-92b6-b4008500b677 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.037351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.038019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.038315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.038586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.039299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.041239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.073518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 956/1918] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:07 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:08.077718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.092376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4e97-778d-4c84-8a58-676e250dfc54 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.165905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.166589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.166962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.167243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.167951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.169918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.191682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 963/1919] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:08.195847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.206741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac80067-56c0-4089-8c8f-efa0cb0ab963 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.211458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.213205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.213333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.213911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.214189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.214460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.215207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.216802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.229097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032375a-816b-4847-aea3-b3c4915b20f8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.229281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 957/1920] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:08.233685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.235583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.236521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.236684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.236977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] PATH_INFO: `/v3/projects/fff506d6e93a43f39e7c289edcc4a1c4` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.238382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff506d6e93a43f39e7c289edcc4a1c4)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.240305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.248000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52bfe7-25e7-4962-b583-844714cca5dd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.252954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.253901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.254182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.254453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] PATH_INFO: `/v3/projects/a4b3e22ff0c54011a3dec0544a97519a/users/d6249770639c4f4bab06c6ef74037951/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.270095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b3e22ff0c54011a3dec0544a97519a, user_id=d6249770639c4f4bab06c6ef74037951, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.272826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.285805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 958/1921] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:08 2022] PUT /identity/v3/projects/a4b3e22ff0c54011a3dec0544a97519a/users/d6249770639c4f4bab06c6ef74037951/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:08.286736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff506d6e93a43f39e7c289edcc4a1c4', 'request_id': 'req-aece82d7-848d-4973-bcfb-c922cd441202'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:08.289733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.293258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff506d6e93a43f39e7c289edcc4a1c4', 'request_id': 'req-aece82d7-848d-4973-bcfb-c922cd441202'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:08.298745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff506d6e93a43f39e7c289edcc4a1c4', 'request_id': 'req-aece82d7-848d-4973-bcfb-c922cd441202'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:08.311431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] The token cache is being invalidate because project fff506d6e93a43f39e7c289edcc4a1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:08.311709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:08.312322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-aece82d7-848d-4973-bcfb-c922cd441202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:08.313950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 964/1922] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:08 2022] DELETE /identity/v3/projects/fff506d6e93a43f39e7c289edcc4a1c4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:08.319945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09593c-b784-425f-86ce-e2f20988ee43 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.320221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09593c-b784-425f-86ce-e2f20988ee43 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.320490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09593c-b784-425f-86ce-e2f20988ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.338397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-0b09593c-b784-425f-86ce-e2f20988ee43 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:08.339584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0b09593c-b784-425f-86ce-e2f20988ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.347683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 965/1923] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:08.349040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd76696-af8e-4f1b-bb49-f729571a06f9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.354700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.355363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.355483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.355637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.355728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.355904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.355990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.356651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.358286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.371934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 959/1924] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:08.372969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.373838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:08.374518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.374983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.382955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 966/1925] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:08.387059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.389993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36331d-d273-4d77-94d5-1b7a4bdf33e1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.395403 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.395906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ae27-c586-4fea-848a-3eecd40dbfc1 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.396286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.396566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.396878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] PATH_INFO: `/v3/projects/a4b3e22ff0c54011a3dec0544a97519a/users/d6249770639c4f4bab06c6ef74037951/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.398842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b3e22ff0c54011a3dec0544a97519a, user_id=d6249770639c4f4bab06c6ef74037951, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.400656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.401316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.401524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.401627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.401844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.402559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:08.402944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.404519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162cc4a-dde0-471e-b0e8-6b1628eeb5a0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.411846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 960/1926] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:08 2022] PUT /identity/v3/projects/a4b3e22ff0c54011a3dec0544a97519a/users/d6249770639c4f4bab06c6ef74037951/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:08.419731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 967/1927] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:08.421038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.422064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.422355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.422682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.449163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] MFA Rules not processed for user `d6249770639c4f4bab06c6ef74037951`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:08.450027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.492261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f38264-a087-4234-872d-6b6625e703cb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.500684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.501527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.501792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.502197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.502920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.504905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.528618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 968/1928] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:08.536160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.537825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.543573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 961/1929] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:08.547527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.611710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488299e9-f634-49b6-8e16-7f7acb6448f1 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.618461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15d51-3e7c-418f-8a60-26ed10d7aaf7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.631079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.631589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.631880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.632159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.633016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.634948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.658365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 962/1930] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:08.662515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.669440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.670180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.670459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.670885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.672837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.672987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f45e8-09b8-4610-9342-3cf67e5cface admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.677638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.678299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.678573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.678842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.679578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.681220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.691629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 963/1931] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:08.695853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.705413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290fb0-9d81-43e8-9661-35f07491b35d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.711147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.711806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.712078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.712349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.713123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.714732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.724853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 964/1932] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:08.729276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:08.733747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.735297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d53fb-54dd-4221-95ec-695ec892da77 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.738814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69d74-38d9-4d4c-b05b-f09f46b1d8c4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:08.743985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:08.744765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 969/1933] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:08.744962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.745247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.745517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] PATH_INFO: `/v3/projects/172871390be64619a96023e53bed2226/users/be7a4d8d6d31423684439296877116e9/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.762760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172871390be64619a96023e53bed2226, user_id=be7a4d8d6d31423684439296877116e9, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:08.765580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:08.798029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 965/1934] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:08 2022] PUT /identity/v3/projects/172871390be64619a96023e53bed2226/users/be7a4d8d6d31423684439296877116e9/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:08.808754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:08.809111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:08.809451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:08.839119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] MFA Rules not processed for user `be7a4d8d6d31423684439296877116e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:08.840579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:08.917666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 970/1935] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:08.922192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.020208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929239fb-bf0e-4d6f-ac76-6ac7fe2e20d4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.026897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.027584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.027863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.028138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.028886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.038942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.096938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 966/1936] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:08 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:09.100459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.112505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc138a-ee9a-42be-9c26-ab853b4612b3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.173419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.174117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.174365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.174635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.175347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.177316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.200017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 971/1937] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:09 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:09.201302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.211691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3337287-05aa-4c09-8d99-5c9f4a036612 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.216336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.217055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.217340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.217629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.218393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.220118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.234182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 967/1938] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:09.235834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.249938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3a917-7eb9-4e4e-a2ac-cd278414d26d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.254685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.255640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.255921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.256196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] PATH_INFO: `/v3/projects/94d95e9022d74832900be42c3fb054ea/users/169ea0fede0641f3947c6825a538f3f1/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.270882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d95e9022d74832900be42c3fb054ea, user_id=169ea0fede0641f3947c6825a538f3f1, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.273778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.289557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 972/1939] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:09 2022] PUT /identity/v3/projects/94d95e9022d74832900be42c3fb054ea/users/169ea0fede0641f3947c6825a538f3f1/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:09.294507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.305952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a16762-a6ea-48a3-b5d4-ba5a727b4513 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.372091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb90a5-1c4b-48f4-97ba-e4a1d39a2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.372810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb90a5-1c4b-48f4-97ba-e4a1d39a2ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.373208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb90a5-1c4b-48f4-97ba-e4a1d39a2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.373482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb90a5-1c4b-48f4-97ba-e4a1d39a2ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.374255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb90a5-1c4b-48f4-97ba-e4a1d39a2ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.375943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb90a5-1c4b-48f4-97ba-e4a1d39a2ce0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.386105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 968/1940] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:09.390732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.401857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f2f1c-b607-47bc-9307-bc06de88a6eb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.406683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.407639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.407944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.408223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] PATH_INFO: `/v3/projects/94d95e9022d74832900be42c3fb054ea/users/169ea0fede0641f3947c6825a538f3f1/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.410264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d95e9022d74832900be42c3fb054ea, user_id=169ea0fede0641f3947c6825a538f3f1, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.412971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.424111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 973/1941] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:09 2022] PUT /identity/v3/projects/94d95e9022d74832900be42c3fb054ea/users/169ea0fede0641f3947c6825a538f3f1/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:09.436113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.436408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.436761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.466421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] MFA Rules not processed for user `169ea0fede0641f3947c6825a538f3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:09.467964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:09.547117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 969/1942] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:09.558813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:09.561318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:09.664654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859381-b28b-4461-a3f6-1a1b3aab9144 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:09.685979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:09.686316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:09.687393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:09.687683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:09.769432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:09.771353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:09.799170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 974/1943] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:10.422404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:10.431729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e7367-ffb7-4939-8db8-5962c87b8aa3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:10.435557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:10.436194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:10.436471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:10.436768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:10.438686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:10.496325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:10.497795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:10.506427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 970/1944] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:12.626613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:12.638658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f787bf6-fd27-4612-a196-27968602814f service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:12.641475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260337b4-5aed-47e7-ae55-b1171d822cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:12.642228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260337b4-5aed-47e7-ae55-b1171d822cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:12.642501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260337b4-5aed-47e7-ae55-b1171d822cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:12.642768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260337b4-5aed-47e7-ae55-b1171d822cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:12.703770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260337b4-5aed-47e7-ae55-b1171d822cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:12.705229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260337b4-5aed-47e7-ae55-b1171d822cd7 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:12.715230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 975/1945] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:13.556252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:13.567970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172f74-45eb-40d1-90c3-291c3def9ff2 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:13.573989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:13.574936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:13.575420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:13.575906 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:13.579085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:13.646241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd0d5-1e8d-4ac0-bd27-d310a6246f43 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:13.646868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd0d5-1e8d-4ac0-bd27-d310a6246f43 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:13.647201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd0d5-1e8d-4ac0-bd27-d310a6246f43 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:13.649435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 976/1946] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 02:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 02:57:13.660527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:13.662035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:13.665105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780a16-7d2e-4ddb-88f2-eac4f1c5e56a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:13.665561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780a16-7d2e-4ddb-88f2-eac4f1c5e56a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:13.665981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780a16-7d2e-4ddb-88f2-eac4f1c5e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:13.673389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 971/1947] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:13.682333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:13.719461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-05780a16-7d2e-4ddb-88f2-eac4f1c5e56a None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:13.720951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-05780a16-7d2e-4ddb-88f2-eac4f1c5e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:13.808780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f201-53db-41e2-a13c-d7e6266724ba service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:13.813833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:13.814724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:13.815005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:13.815283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] PATH_INFO: `/v3/users/be7a4d8d6d31423684439296877116e9` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:13.816665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7a4d8d6d31423684439296877116e9)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:13.819413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:13.828754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 977/1948] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:13.905478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7a4d8d6d31423684439296877116e9'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:13.915270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7a4d8d6d31423684439296877116e9'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:13.916355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7a4d8d6d31423684439296877116e9'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:13.926935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7a4d8d6d31423684439296877116e9'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:13.945559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7a4d8d6d31423684439296877116e9'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:13.955992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 972/1949] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:13 2022] DELETE /identity/v3/users/be7a4d8d6d31423684439296877116e9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:13.961111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f6116-ad8c-445a-a790-63b261770268 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:13.961398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f6116-ad8c-445a-a790-63b261770268 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:13.961765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f6116-ad8c-445a-a790-63b261770268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:14.000519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-980f6116-ad8c-445a-a790-63b261770268 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:14.002077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-980f6116-ad8c-445a-a790-63b261770268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:14.034362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:14.036760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:14.148835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 978/1950] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:14.160541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f6116-ad8c-445a-a790-63b261770268 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:14.161997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-980f6116-ad8c-445a-a790-63b261770268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:14.197581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1cb1d-8560-4dd9-8e4f-de55df9c82d2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:14.203734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:14.204797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:14.205096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:14.205406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:14.207773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:14.230090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:14.232226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:14.256608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 973/1951] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:14.275215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f6116-ad8c-445a-a790-63b261770268 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:14.284697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:14.289899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:14.289899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:14.289899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:14.314964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:14.316473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:14.338957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 979/1952] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:14.669195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:14.671512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:14.694871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a8f6-38b4-446f-8c2b-8f1ba2abc154 service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:14.701081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:14.701941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:14.702221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:14.702487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] PATH_INFO: `/v3/projects/172871390be64619a96023e53bed2226` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:14.704164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] RBAC: Authorizing `identity:delete_project(project_id=172871390be64619a96023e53bed2226)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:14.706373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:14.753980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172871390be64619a96023e53bed2226', 'request_id': 'req-a911ca80-f7ff-419c-b402-24cb7b16481d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.763835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172871390be64619a96023e53bed2226', 'request_id': 'req-a911ca80-f7ff-419c-b402-24cb7b16481d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.771361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172871390be64619a96023e53bed2226', 'request_id': 'req-a911ca80-f7ff-419c-b402-24cb7b16481d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.781604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] The token cache is being invalidate because project 172871390be64619a96023e53bed2226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:14.781855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.782472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.784036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 974/1953] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:14 2022] DELETE /identity/v3/projects/172871390be64619a96023e53bed2226 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:14.788229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:14.798499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5702-3702-437d-a9f4-754c875f321e service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:14.864470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:14.865448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:14.865725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:14.866030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] PATH_INFO: `/v3/users/169ea0fede0641f3947c6825a538f3f1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:14.867317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169ea0fede0641f3947c6825a538f3f1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:14.869303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:14.922417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169ea0fede0641f3947c6825a538f3f1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.923113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169ea0fede0641f3947c6825a538f3f1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.929864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169ea0fede0641f3947c6825a538f3f1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.941886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169ea0fede0641f3947c6825a538f3f1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.951074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-08dcef33-49ec-41f8-99fd-01e7e9019510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169ea0fede0641f3947c6825a538f3f1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:14.957397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 980/1954] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:14 2022] DELETE /identity/v3/users/169ea0fede0641f3947c6825a538f3f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:15.261067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.262687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:15.278103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ca80-f7ff-419c-b402-24cb7b16481d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.366408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.367592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.367961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.368188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] PATH_INFO: `/v3/projects/94d95e9022d74832900be42c3fb054ea` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.369642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d95e9022d74832900be42c3fb054ea)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.372690 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.422461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d95e9022d74832900be42c3fb054ea', 'request_id': 'req-50b8007a-a447-47aa-a606-940a5a18d04a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:15.430939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d95e9022d74832900be42c3fb054ea', 'request_id': 'req-50b8007a-a447-47aa-a606-940a5a18d04a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:15.437986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d95e9022d74832900be42c3fb054ea', 'request_id': 'req-50b8007a-a447-47aa-a606-940a5a18d04a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:15.449723 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] The token cache is being invalidate because project 94d95e9022d74832900be42c3fb054ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:15.450237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:15.450961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-50b8007a-a447-47aa-a606-940a5a18d04a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:15.452832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 975/1955] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:15 2022] DELETE /identity/v3/projects/94d95e9022d74832900be42c3fb054ea => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:15.458703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.459309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.459667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.479704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:15.482194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:15.550020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 981/1956] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:15.558183 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.558560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.559362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.587424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:15.588885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:15.607664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 976/1957] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:15.609072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.618613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a0bf4-5984-41c1-b964-31f38212303b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.624036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.624794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.625071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.625361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.626225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:15.626633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.629438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.640833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 982/1958] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:15.644978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.655791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb146bf-07fd-4e18-bbae-e9d0bef77ae8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.660907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.661637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.662499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.662861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.663654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.665737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.695190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 977/1959] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:15 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:15.699426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.711757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76841b-6f32-4601-8fe4-1257037aa349 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.771605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.772275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.772554 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.772856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.773569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.775641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.801512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 983/1960] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:15 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:15.802634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.812910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f73b-9432-487c-8874-5d1777361045 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.817571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.818246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.818527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.818801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.819587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.821242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.833586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 978/1961] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:15.838024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.848372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3226fc-078b-4094-a443-6c2930eda4a4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.853189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6c8d1-0318-46da-b5bf-5ef90454ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.855403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c8d1-0318-46da-b5bf-5ef90454ee7a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.855403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c8d1-0318-46da-b5bf-5ef90454ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.855403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c8d1-0318-46da-b5bf-5ef90454ee7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.855655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6c8d1-0318-46da-b5bf-5ef90454ee7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.857115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6c8d1-0318-46da-b5bf-5ef90454ee7a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.867748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 984/1962] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:15.872331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:15.884057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c5c37-6b12-4691-a810-e5358b9602b1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:15.890260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:15.891355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.891730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.892101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] PATH_INFO: `/v3/projects/15c4256dc55e466d95808fa66f72c37d/users/3754bf46af13470faf170277d5086e88/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.908840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c4256dc55e466d95808fa66f72c37d, user_id=3754bf46af13470faf170277d5086e88, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:15.913566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:15.928491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 979/1963] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:15 2022] PUT /identity/v3/projects/15c4256dc55e466d95808fa66f72c37d/users/3754bf46af13470faf170277d5086e88/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:15.933737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6628-8266-4611-86ee-e89869784fc8 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:15.934022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6628-8266-4611-86ee-e89869784fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:15.934293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6628-8266-4611-86ee-e89869784fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:15.953549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6aff6628-8266-4611-86ee-e89869784fc8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:15.954784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6aff6628-8266-4611-86ee-e89869784fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:16.015559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 985/1964] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:16.025296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:16.027101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:16.085840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b95b3-3e6e-4483-98c2-5002f720e5c1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:16.091273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:16.091892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:16.092344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:16.092612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:16.104701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:16.106904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:16.118372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 980/1965] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:16.976595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05a9d3-4866-4a79-8ac9-7aac51d8c6fa None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:16.977193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05a9d3-4866-4a79-8ac9-7aac51d8c6fa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:16.977193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05a9d3-4866-4a79-8ac9-7aac51d8c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:17.004981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1b05a9d3-4866-4a79-8ac9-7aac51d8c6fa None None] MFA Rules not processed for user `3754bf46af13470faf170277d5086e88`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:17.006413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1b05a9d3-4866-4a79-8ac9-7aac51d8c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:17.077213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 986/1966] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:17.087415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:17.088838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:17.144969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58eb9-1401-4bdf-af14-3d0bce9d8865 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:17.148673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:17.149358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:17.149638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:17.149913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:17.158140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:17.159586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:17.168152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 981/1967] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:18.598522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d26f7a-8ef7-48f5-b3ed-7c58f2892291 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:18.599086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d26f7a-8ef7-48f5-b3ed-7c58f2892291 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:18.599086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d26f7a-8ef7-48f5-b3ed-7c58f2892291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:18.618068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-32d26f7a-8ef7-48f5-b3ed-7c58f2892291 None None] MFA Rules not processed for user `3754bf46af13470faf170277d5086e88`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:18.619264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-32d26f7a-8ef7-48f5-b3ed-7c58f2892291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:18.630064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 987/1968] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:18.968678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:18.970265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:18.984515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9897-a9bb-490e-b717-1c349ef6d21a service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:18.989489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:18.990359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:18.990640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:18.990936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] PATH_INFO: `/v3/users/376c2cd288904799ae5038483f582000` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:18.992141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376c2cd288904799ae5038483f582000)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:18.994094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:19.038795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376c2cd288904799ae5038483f582000'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.046161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376c2cd288904799ae5038483f582000'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.046797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376c2cd288904799ae5038483f582000'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.054185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376c2cd288904799ae5038483f582000'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.066021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376c2cd288904799ae5038483f582000'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.072457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 982/1969] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:18 2022] DELETE /identity/v3/users/376c2cd288904799ae5038483f582000 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:19.077416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:19.077701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:19.077982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:19.100897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:19.102279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:19.163866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 988/1970] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:19.174691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:19.176414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:19.253963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4699fb-81e3-4d11-ab25-c217bd837225 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:19.258753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:19.259417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:19.260516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:19.260922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:19.280467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:19.282500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:19.294637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 983/1971] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:19.678697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:19.680247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:19.698503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2971592-ec19-439d-bfee-90783611dab9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:19.703869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:19.704607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:19.704947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:19.705207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] PATH_INFO: `/v3/projects/541ea1ef008340c1958113a42d887b16` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:19.706500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541ea1ef008340c1958113a42d887b16)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:19.708512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:19.757325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541ea1ef008340c1958113a42d887b16', 'request_id': 'req-e710abe2-902a-4bbe-8811-f4e936c5fcd7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.763876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541ea1ef008340c1958113a42d887b16', 'request_id': 'req-e710abe2-902a-4bbe-8811-f4e936c5fcd7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.769650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541ea1ef008340c1958113a42d887b16', 'request_id': 'req-e710abe2-902a-4bbe-8811-f4e936c5fcd7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.782315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] The token cache is being invalidate because project 541ea1ef008340c1958113a42d887b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:19.782607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.783271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.784852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 989/1972] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:19 2022] DELETE /identity/v3/projects/541ea1ef008340c1958113a42d887b16 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:19.788918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:19.799022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a453-ae58-49da-bf0a-e9e81ddd63ef service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:19.857518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:19.858332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:19.858604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:19.858876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] PATH_INFO: `/v3/users/ca6e0c35dd97498298460e396324fe60` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:19.860152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6e0c35dd97498298460e396324fe60)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:19.862126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:19.911436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6e0c35dd97498298460e396324fe60'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.920824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6e0c35dd97498298460e396324fe60'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.921460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6e0c35dd97498298460e396324fe60'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.928441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6e0c35dd97498298460e396324fe60'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.940376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6e0c35dd97498298460e396324fe60'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:19.947000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 984/1973] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:19 2022] DELETE /identity/v3/users/ca6e0c35dd97498298460e396324fe60 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:20.281769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:20.285988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:20.304137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710abe2-902a-4bbe-8811-f4e936c5fcd7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:20.379321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:20.380134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:20.380410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:20.380686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] PATH_INFO: `/v3/projects/e81e4bf534394f9cab3473e5cd52a60b` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:20.381913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81e4bf534394f9cab3473e5cd52a60b)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:20.383908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:20.431133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81e4bf534394f9cab3473e5cd52a60b', 'request_id': 'req-8d146dca-0da2-4004-8413-9491afd58563'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.437434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81e4bf534394f9cab3473e5cd52a60b', 'request_id': 'req-8d146dca-0da2-4004-8413-9491afd58563'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.444891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81e4bf534394f9cab3473e5cd52a60b', 'request_id': 'req-8d146dca-0da2-4004-8413-9491afd58563'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.458830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] The token cache is being invalidate because project e81e4bf534394f9cab3473e5cd52a60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:20.459535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.459778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.461392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 990/1974] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:20 2022] DELETE /identity/v3/projects/e81e4bf534394f9cab3473e5cd52a60b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:20.465443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:20.466928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:20.479870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd0a76-847a-4f0f-bc4c-87cc5e9240a7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:20.541214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:20.542102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:20.542377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:20.542645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] PATH_INFO: `/v3/users/d6249770639c4f4bab06c6ef74037951` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:20.543848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6249770639c4f4bab06c6ef74037951)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:20.545806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:20.597970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6249770639c4f4bab06c6ef74037951'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.606862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6249770639c4f4bab06c6ef74037951'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.607563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6249770639c4f4bab06c6ef74037951'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.615034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6249770639c4f4bab06c6ef74037951'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.627052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e0c9c797-88ae-4d11-b110-b708425b6852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6249770639c4f4bab06c6ef74037951'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:20.636518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 985/1975] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:20 2022] DELETE /identity/v3/users/d6249770639c4f4bab06c6ef74037951 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:20.905186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:20.906681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:20.921937 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d146dca-0da2-4004-8413-9491afd58563 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:20.978289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:20.979515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:20.979819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:20.980089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] PATH_INFO: `/v3/projects/a4b3e22ff0c54011a3dec0544a97519a` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:20.981374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b3e22ff0c54011a3dec0544a97519a)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:20.983358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.030635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b3e22ff0c54011a3dec0544a97519a', 'request_id': 'req-21316716-b313-4f2b-adc1-d7c13203eeb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.037119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b3e22ff0c54011a3dec0544a97519a', 'request_id': 'req-21316716-b313-4f2b-adc1-d7c13203eeb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.043403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b3e22ff0c54011a3dec0544a97519a', 'request_id': 'req-21316716-b313-4f2b-adc1-d7c13203eeb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.056530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] The token cache is being invalidate because project a4b3e22ff0c54011a3dec0544a97519a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:21.056845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.057474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-21316716-b313-4f2b-adc1-d7c13203eeb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.059013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 991/1976] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:20 2022] DELETE /identity/v3/projects/a4b3e22ff0c54011a3dec0544a97519a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:21.065215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.065527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.065823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.085066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:21.086258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:21.144474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 986/1977] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:21.153144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.153443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.153721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.174727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:21.175985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:21.184842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 992/1978] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:21.190074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.206277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7da0e-75b9-4852-94a1-34b19ff384d8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.215453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.216596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.217102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.217447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.218512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:21.218908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.220697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.233122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 987/1979] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:21.237477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.247047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1a991-eff6-4abf-9a35-13e1fcf35d4f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.253598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.254240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.254514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.254776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.255499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.257505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.290744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 993/1980] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:21 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:21.291904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.302118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d260-1e1b-4be7-818d-aefdb2b95a49 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.365571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.366250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.366555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.366827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.369474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.371589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.396871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 988/1981] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:21 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:21.398146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.408752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660446-a419-4182-8b96-06f504c2684e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.413855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.414518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.414791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.415061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.415775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.417426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.428800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 994/1982] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:21.432628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.443520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7da02a-5d70-497a-ab73-a854e6546ca6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.451327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a14ab-187f-495e-a2b3-e0fef7b62522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.452170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a14ab-187f-495e-a2b3-e0fef7b62522 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.452596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a14ab-187f-495e-a2b3-e0fef7b62522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.452997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a14ab-187f-495e-a2b3-e0fef7b62522 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.454330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a14ab-187f-495e-a2b3-e0fef7b62522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.455953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a14ab-187f-495e-a2b3-e0fef7b62522 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.470565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 989/1983] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:21.474932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.486629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f80b3b-819d-41bd-807e-ed7be7e897f9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.491822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.492898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.493184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.493631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] PATH_INFO: `/v3/projects/51e7936d6e0c4cd8ae33edcd44fa44e9/users/111010642e554a8fab78b6358502e5e3/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.509865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e7936d6e0c4cd8ae33edcd44fa44e9, user_id=111010642e554a8fab78b6358502e5e3, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.512556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.527663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 995/1984] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:21 2022] PUT /identity/v3/projects/51e7936d6e0c4cd8ae33edcd44fa44e9/users/111010642e554a8fab78b6358502e5e3/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:21.538043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.538332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.538609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.566586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] MFA Rules not processed for user `111010642e554a8fab78b6358502e5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:21.567822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:21.640432 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 990/1985] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:21.651709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.653682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:21.714902 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d5a7c-8ef6-4cf3-af75-90f19b9957ee admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.718825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1aa28-dc21-478e-b069-4046b25f61a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.719506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1aa28-dc21-478e-b069-4046b25f61a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.719789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1aa28-dc21-478e-b069-4046b25f61a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.720066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1aa28-dc21-478e-b069-4046b25f61a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.729130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1aa28-dc21-478e-b069-4046b25f61a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.730591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1aa28-dc21-478e-b069-4046b25f61a2 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.739818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 996/1986] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:21.771968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:21.838329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc4905-6920-4770-8b23-680b52bf12f8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:21.845080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:21.846030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.846498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.846654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] PATH_INFO: `/v3/users/111010642e554a8fab78b6358502e5e3` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.847979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111010642e554a8fab78b6358502e5e3)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:21.850132 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:21.927090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111010642e554a8fab78b6358502e5e3'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.936063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111010642e554a8fab78b6358502e5e3'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.937097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111010642e554a8fab78b6358502e5e3'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.948165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111010642e554a8fab78b6358502e5e3'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.967344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111010642e554a8fab78b6358502e5e3'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:21.974434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 991/1987] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:21 2022] DELETE /identity/v3/users/111010642e554a8fab78b6358502e5e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:21.979471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:21.979934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:21.981071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:21.999796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:22.001262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:22.084413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 997/1988] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:22.094585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.096006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:22.172789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263f7dd-34c8-4a4c-b45f-b5b94ffba601 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.177995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa422da-9cb4-4f25-96e0-871aedffcd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.178673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa422da-9cb4-4f25-96e0-871aedffcd60 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.178933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa422da-9cb4-4f25-96e0-871aedffcd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.179198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa422da-9cb4-4f25-96e0-871aedffcd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.190909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa422da-9cb4-4f25-96e0-871aedffcd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.192581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa422da-9cb4-4f25-96e0-871aedffcd60 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.202549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 992/1989] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:22.465404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.466837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:22.479461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbe3e5-a6ae-4791-b7be-105f2e4e17f5 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.485168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.486029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.486297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.486569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] PATH_INFO: `/v3/projects/51e7936d6e0c4cd8ae33edcd44fa44e9` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.488095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e7936d6e0c4cd8ae33edcd44fa44e9)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.490112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.538195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e7936d6e0c4cd8ae33edcd44fa44e9', 'request_id': 'req-ae35f97b-fcf4-484c-bfe5-5e70c5158933'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:22.544319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e7936d6e0c4cd8ae33edcd44fa44e9', 'request_id': 'req-ae35f97b-fcf4-484c-bfe5-5e70c5158933'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:22.549654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e7936d6e0c4cd8ae33edcd44fa44e9', 'request_id': 'req-ae35f97b-fcf4-484c-bfe5-5e70c5158933'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:22.563580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] The token cache is being invalidate because project 51e7936d6e0c4cd8ae33edcd44fa44e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:22.563846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:22.564500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ae35f97b-fcf4-484c-bfe5-5e70c5158933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:22.566072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 998/1990] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:22 2022] DELETE /identity/v3/projects/51e7936d6e0c4cd8ae33edcd44fa44e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:22.571796 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.572329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.572329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.590187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:22.591374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:22.649416 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 993/1991] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:22.657794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.658109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.658380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.678247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:22.679497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:22.688337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 999/1992] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:22.692601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.702213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74fa8-54e1-44f0-ac0c-520a0c507c02 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.706952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.707593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.707875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.708190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.708900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:22.709209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.710814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.722471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 994/1993] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:22.726866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.736857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f68fd-205f-462c-87ef-236dbb21d2c8 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.742396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.743057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.743339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.743611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.744319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.746298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.776959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1000/1994] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:22 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:22.777869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.788869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ef0df-fc65-4f48-b01d-8be28f72c8a2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.845571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.846240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.846524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.846800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.847544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.849526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.872034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 995/1995] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:22 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:22.876116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.886477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bc208-b879-4484-93c3-2605cd4e417b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.891593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.892460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.892555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.892832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.897529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.899475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.912662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1001/1996] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:22.917275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.932030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574636f2-a302-4898-bc1f-c42b2961c736 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.943189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ffa20-cd2f-44c5-83b1-c2a3021070ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.944863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ffa20-cd2f-44c5-83b1-c2a3021070ab admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.945159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ffa20-cd2f-44c5-83b1-c2a3021070ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.945430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ffa20-cd2f-44c5-83b1-c2a3021070ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:22.946245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ffa20-cd2f-44c5-83b1-c2a3021070ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:22.949224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ffa20-cd2f-44c5-83b1-c2a3021070ab admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:22.962330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 996/1997] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:22.966476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:22.978243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb893e-b515-4db9-b657-90c9e945e25e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:22.983962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:22.990331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:22.990331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:22.990331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] PATH_INFO: `/v3/projects/32b005a4be7b40aab2f79fc959cd6549/users/befc8b34ea6540d3991b23a58f729736/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:23.003779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b005a4be7b40aab2f79fc959cd6549, user_id=befc8b34ea6540d3991b23a58f729736, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:23.006784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:23.045838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1002/1998] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:22 2022] PUT /identity/v3/projects/32b005a4be7b40aab2f79fc959cd6549/users/befc8b34ea6540d3991b23a58f729736/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:23.051992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b5f1-1a96-433e-a3af-3e67812e4f74 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:23.052281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b5f1-1a96-433e-a3af-3e67812e4f74 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:23.052559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b5f1-1a96-433e-a3af-3e67812e4f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:23.088873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8787b5f1-1a96-433e-a3af-3e67812e4f74 None None] MFA Rules not processed for user `befc8b34ea6540d3991b23a58f729736`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:23.090202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8787b5f1-1a96-433e-a3af-3e67812e4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:23.162603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 997/1999] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:23.172442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:23.174433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:23.230108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a8fec-47aa-45df-926e-2fb03758e082 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:23.233871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:23.234590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:23.234868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:23.235774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:23.243936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:23.245703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:23.255654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1003/2000] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:26.713049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146edc-b6ec-4c18-a5d8-d3f73b21c241 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:26.713591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146edc-b6ec-4c18-a5d8-d3f73b21c241 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:26.713591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146edc-b6ec-4c18-a5d8-d3f73b21c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:26.731505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8f146edc-b6ec-4c18-a5d8-d3f73b21c241 None None] MFA Rules not processed for user `befc8b34ea6540d3991b23a58f729736`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:26.732783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8f146edc-b6ec-4c18-a5d8-d3f73b21c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:26.744243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 998/2001] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:32.455809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:32.457275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:32.550104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6c41-f5d3-4ff1-9678-4c9911b55ee7 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:32.554728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:32.555601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:32.555879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:32.556159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] PATH_INFO: `/v3/users/c988b35edaa14743907463cf1939d854` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:32.557629 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c988b35edaa14743907463cf1939d854)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:32.559572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:32.626698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c988b35edaa14743907463cf1939d854'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:32.628090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c988b35edaa14743907463cf1939d854'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:32.639109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c988b35edaa14743907463cf1939d854'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:32.653236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c988b35edaa14743907463cf1939d854'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:32.663220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c988b35edaa14743907463cf1939d854'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:32.670349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1004/2002] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:32 2022] DELETE /identity/v3/users/c988b35edaa14743907463cf1939d854 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:32.675238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:32.675742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:32.675865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:32.694670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:32.695899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:32.760372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 999/2003] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:32.771323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:32.772922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:32.828958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892b5a-fdf7-45cb-a7d0-fdcad73268ed admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:32.832936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:32.833680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:32.834063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:32.834432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:32.844696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:32.846242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:32.856497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1005/2004] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:33.337506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:33.338936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:33.352598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7eda2-9cf0-4e99-86e1-55dc1cd054c3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:33.358926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:33.359858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:33.360318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:33.360624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] PATH_INFO: `/v3/projects/bbecd1425b924535baf609b93b1fb771` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:33.368235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbecd1425b924535baf609b93b1fb771)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:33.370261 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:33.417471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbecd1425b924535baf609b93b1fb771', 'request_id': 'req-21d3d571-c7d0-4dcf-b02e-369058217401'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.425258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbecd1425b924535baf609b93b1fb771', 'request_id': 'req-21d3d571-c7d0-4dcf-b02e-369058217401'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.431343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbecd1425b924535baf609b93b1fb771', 'request_id': 'req-21d3d571-c7d0-4dcf-b02e-369058217401'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.442528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] The token cache is being invalidate because project bbecd1425b924535baf609b93b1fb771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:33.442815 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.443452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.445221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1000/2005] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:33 2022] DELETE /identity/v3/projects/bbecd1425b924535baf609b93b1fb771 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:33.449867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:33.459990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9c64-2fdf-4e87-b221-7ea44d64962e service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:33.521771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:33.522685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:33.522965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:33.523237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] PATH_INFO: `/v3/users/bd23a6941f714a839e938e52f3d289d6` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:33.524415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd23a6941f714a839e938e52f3d289d6)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:33.526705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:33.581846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd23a6941f714a839e938e52f3d289d6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.582918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd23a6941f714a839e938e52f3d289d6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.592147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd23a6941f714a839e938e52f3d289d6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.610373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd23a6941f714a839e938e52f3d289d6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.628259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-510e141b-1885-4c09-a26f-ed38f5029b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd23a6941f714a839e938e52f3d289d6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:33.640896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1006/2006] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:33 2022] DELETE /identity/v3/users/bd23a6941f714a839e938e52f3d289d6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:33.912362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:33.913977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:33.927683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d571-c7d0-4dcf-b02e-369058217401 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:33.983552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:33.984464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:33.984805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:33.985059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] PATH_INFO: `/v3/projects/34d52bdd89304ed397d7cc5704f4148c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:33.986270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d52bdd89304ed397d7cc5704f4148c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:33.988161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.034993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d52bdd89304ed397d7cc5704f4148c', 'request_id': 'req-ce77ec6e-7909-4d2e-9013-8d29a08a490a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:34.044214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d52bdd89304ed397d7cc5704f4148c', 'request_id': 'req-ce77ec6e-7909-4d2e-9013-8d29a08a490a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:34.051339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d52bdd89304ed397d7cc5704f4148c', 'request_id': 'req-ce77ec6e-7909-4d2e-9013-8d29a08a490a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:34.064249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] The token cache is being invalidate because project 34d52bdd89304ed397d7cc5704f4148c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:34.064537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:34.065280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ce77ec6e-7909-4d2e-9013-8d29a08a490a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:34.071156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1001/2007] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:33 2022] DELETE /identity/v3/projects/34d52bdd89304ed397d7cc5704f4148c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:34.074367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.074884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.075147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.096895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:34.098112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:34.158400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1007/2008] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:34.166249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.166464 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.166741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.184913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:34.186068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:34.195565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1002/2009] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:34.199686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.209795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0e84d-ca48-43de-b52c-f400881051b2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.214622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.215270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.215545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.215813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.216541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:34.216873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.218507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.230808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1008/2010] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:34.235280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.244421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1c56-8821-4cde-adb7-202c4662c532 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.249238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.249864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.250171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.250447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.251184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.253100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.280941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1003/2011] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:34.286225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.296092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44288584-aa5f-43e9-8f7d-1902463a4c47 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.352383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.353083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.353723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.354028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.354725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.356640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.384627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1009/2012] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:34.389018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.399701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034f947-ef46-4f87-8b20-f7343edfcbb9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.404747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.405488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.405930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.406352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.407253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.408968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.421186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1004/2013] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:34.425433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.435220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d15f6b-0653-4448-858f-ff66e83c955b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.439830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94a08e-230f-48f7-b8e5-e81a7ee184c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.440497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94a08e-230f-48f7-b8e5-e81a7ee184c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.440805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94a08e-230f-48f7-b8e5-e81a7ee184c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.441083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94a08e-230f-48f7-b8e5-e81a7ee184c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.441822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94a08e-230f-48f7-b8e5-e81a7ee184c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.443425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94a08e-230f-48f7-b8e5-e81a7ee184c6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.453575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1010/2014] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:34.457771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.468851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382eab-4c9b-4b94-ba94-d774fa9e5d2a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.474145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.475106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.475460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.475790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] PATH_INFO: `/v3/projects/fd1e7d9262af41fba0eb1f2f31d1047c/users/d585e8467a1a48d5891952e3ba34505e/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.491380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1e7d9262af41fba0eb1f2f31d1047c, user_id=d585e8467a1a48d5891952e3ba34505e, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.494057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.512177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1005/2015] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:34 2022] PUT /identity/v3/projects/fd1e7d9262af41fba0eb1f2f31d1047c/users/d585e8467a1a48d5891952e3ba34505e/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:34.522662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.523175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.523175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.549539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] MFA Rules not processed for user `d585e8467a1a48d5891952e3ba34505e`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:34.550764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:34.615055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1011/2016] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:34.619479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.682375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d5a80-cfc2-4a53-906e-d12b5631081d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.687468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.688174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.688447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.688738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.689455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.691377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.718775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1006/2017] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:34.722992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.734046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4ff4-651c-4045-bade-62573f438cec None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.793260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.793925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.794202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.794489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.795194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.797199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.819313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1012/2018] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:34 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:34.823459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.833610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182a232-1a5c-4c1c-bcdd-d75ec3635f26 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.838323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.838971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.839238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.839518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.840249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.841873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.852485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1007/2019] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:34.857022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.867149 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1264b9-8d10-4fb8-8083-9d41ace96511 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.872357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.873294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.873574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.873844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] PATH_INFO: `/v3/projects/8ad215fd991e470ea2f99b34c0d9d7f2/users/c62f4753f6f443fc870074f7c1048ffe/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.888731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad215fd991e470ea2f99b34c0d9d7f2, user_id=c62f4753f6f443fc870074f7c1048ffe, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.891408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.907175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1013/2020] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:34 2022] PUT /identity/v3/projects/8ad215fd991e470ea2f99b34c0d9d7f2/users/c62f4753f6f443fc870074f7c1048ffe/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:34.911289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:34.921086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429a5b-67c0-4492-bd6e-8d94d0a78170 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:34.978177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c20fd2-d23f-4b23-a5e0-0faf6baf7e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:34.979199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20fd2-d23f-4b23-a5e0-0faf6baf7e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:34.979469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20fd2-d23f-4b23-a5e0-0faf6baf7e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:34.979739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20fd2-d23f-4b23-a5e0-0faf6baf7e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:34.980475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c20fd2-d23f-4b23-a5e0-0faf6baf7e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:34.982117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c20fd2-d23f-4b23-a5e0-0faf6baf7e04 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:34.992807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1008/2021] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:34.997254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:35.007352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016c897-d834-41e3-a7ad-0a54fbc33be8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:35.011920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:35.012819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:35.013099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:35.013369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] PATH_INFO: `/v3/projects/8ad215fd991e470ea2f99b34c0d9d7f2/users/c62f4753f6f443fc870074f7c1048ffe/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:35.015412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad215fd991e470ea2f99b34c0d9d7f2, user_id=c62f4753f6f443fc870074f7c1048ffe, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:35.018209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:35.028044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1014/2022] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:34 2022] PUT /identity/v3/projects/8ad215fd991e470ea2f99b34c0d9d7f2/users/c62f4753f6f443fc870074f7c1048ffe/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:35.039126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:35.039460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:35.039715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:35.068340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] MFA Rules not processed for user `c62f4753f6f443fc870074f7c1048ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:35.069582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:35.143101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1009/2023] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:35.153522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:35.155510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:35.214901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce2bd-855b-4211-a33c-7892cfeb7909 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:35.219288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12164b-98c3-41db-aa3f-38c0590f1582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:35.219880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12164b-98c3-41db-aa3f-38c0590f1582 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:35.220160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12164b-98c3-41db-aa3f-38c0590f1582 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:35.220439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12164b-98c3-41db-aa3f-38c0590f1582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:35.230934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12164b-98c3-41db-aa3f-38c0590f1582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:35.232397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12164b-98c3-41db-aa3f-38c0590f1582 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:35.242204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1015/2024] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:35.313989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:35.323578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb9612-9f9a-4406-9a5e-a92492b611f7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:35.327190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:35.327841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:35.328115 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:35.328417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:35.384393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:35.385887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:35.396135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1010/2025] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:38.708994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8e2e-8cb8-4d64-84ee-8d3e8554e711 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:38.709536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8e2e-8cb8-4d64-84ee-8d3e8554e711 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:38.709536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8e2e-8cb8-4d64-84ee-8d3e8554e711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:38.728824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4b8b8e2e-8cb8-4d64-84ee-8d3e8554e711 None None] MFA Rules not processed for user `087b5f4f3891413b8b7fa727768c09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:38.730035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4b8b8e2e-8cb8-4d64-84ee-8d3e8554e711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:38.792772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1016/2026] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:42.464708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:42.466209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:42.552817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aa922-7806-48ec-a4b0-63c3dd630172 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:42.558179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:42.559251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:42.559540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:42.559813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] PATH_INFO: `/v3/users/bdc46081236f412398632ee27ddc831f` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:42.561051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc46081236f412398632ee27ddc831f)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:42.563302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:42.619138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc46081236f412398632ee27ddc831f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:42.628479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc46081236f412398632ee27ddc831f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:42.629154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc46081236f412398632ee27ddc831f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:42.637334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc46081236f412398632ee27ddc831f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:42.649618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc46081236f412398632ee27ddc831f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:42.656280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1011/2027] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:42 2022] DELETE /identity/v3/users/bdc46081236f412398632ee27ddc831f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:42.661494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377b450-7267-4756-becd-230f70500c09 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:42.661994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377b450-7267-4756-becd-230f70500c09 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:42.662633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377b450-7267-4756-becd-230f70500c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:42.682824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5377b450-7267-4756-becd-230f70500c09 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:42.684250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5377b450-7267-4756-becd-230f70500c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:42.773303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1017/2028] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:42.783127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:42.785073 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:42.865207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b7de-1d4b-4bb7-99c5-03ebb37db4fa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:42.869624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:42.870283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:42.870555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:42.870818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:42.881693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:42.883127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:42.892950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1012/2029] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:43.410597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377b450-7267-4756-becd-230f70500c09 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:43.412172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5377b450-7267-4756-becd-230f70500c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:43.427929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377b450-7267-4756-becd-230f70500c09 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:43.441893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:43.443171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:43.443445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:43.443876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] PATH_INFO: `/v3/projects/fed92431de1b47a68ea6f1e470972139` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:43.445612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed92431de1b47a68ea6f1e470972139)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:43.448530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:43.510222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed92431de1b47a68ea6f1e470972139', 'request_id': 'req-1c770885-6214-48ef-833f-51a2cfbc6ff3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.519129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed92431de1b47a68ea6f1e470972139', 'request_id': 'req-1c770885-6214-48ef-833f-51a2cfbc6ff3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.525792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed92431de1b47a68ea6f1e470972139', 'request_id': 'req-1c770885-6214-48ef-833f-51a2cfbc6ff3'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.544405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] The token cache is being invalidate because project fed92431de1b47a68ea6f1e470972139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:43.544901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.545758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.547916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1018/2030] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:43 2022] DELETE /identity/v3/projects/fed92431de1b47a68ea6f1e470972139 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:43.551774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:43.564458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c65408-65ce-4f41-8f3d-7f63d5c8e888 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:43.664314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:43.665332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:43.665512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:43.665934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] PATH_INFO: `/v3/users/9ec6a6f434c642e1b51868a11de8ab17` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:43.667481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec6a6f434c642e1b51868a11de8ab17)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:43.671777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:43.753986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec6a6f434c642e1b51868a11de8ab17'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.768966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec6a6f434c642e1b51868a11de8ab17'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.770316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec6a6f434c642e1b51868a11de8ab17'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.782446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec6a6f434c642e1b51868a11de8ab17'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.802830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ee67cd89-915f-4a23-986d-8600939f02a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec6a6f434c642e1b51868a11de8ab17'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:43.812627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1013/2031] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:43 2022] DELETE /identity/v3/users/9ec6a6f434c642e1b51868a11de8ab17 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:44.206434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.207895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:44.224846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c770885-6214-48ef-833f-51a2cfbc6ff3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.284958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.285723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.285922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.286171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] PATH_INFO: `/v3/projects/c58d93173c4542c29e1be2165bd20258` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.287579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58d93173c4542c29e1be2165bd20258)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.289582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.340828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58d93173c4542c29e1be2165bd20258', 'request_id': 'req-2cd74327-5cfb-4860-9ad0-1d29715fce45'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:44.347477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58d93173c4542c29e1be2165bd20258', 'request_id': 'req-2cd74327-5cfb-4860-9ad0-1d29715fce45'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:44.362862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58d93173c4542c29e1be2165bd20258', 'request_id': 'req-2cd74327-5cfb-4860-9ad0-1d29715fce45'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:44.375966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] The token cache is being invalidate because project c58d93173c4542c29e1be2165bd20258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:44.376196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:44.376907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2cd74327-5cfb-4860-9ad0-1d29715fce45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:44.378659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1019/2032] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:44 2022] DELETE /identity/v3/projects/c58d93173c4542c29e1be2165bd20258 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:44.384848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.385108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.385382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.405458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:44.406662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:44.487863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1014/2033] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:44.489722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.490042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.490323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.509351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:44.510723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:44.520201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1020/2034] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:44.525240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.535577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cca49e-f3d9-435b-99e5-87c5048cc644 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.540181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.540964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.541303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.541653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.542499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:44.542858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.544518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.556790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1015/2035] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:44.561146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.572218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f226a7-34d2-45e4-a845-8e5c71c51bf1 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.577959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.578768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.579262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.579637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.580524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.582564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.612225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1021/2036] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:44 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:44.616556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.626939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476b5d-c72d-49f7-a0b7-5e675cb33ae6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.680634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.681345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.681608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.681876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.682603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.684539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.708027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1016/2037] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:44 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:44.709702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.721480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d05bf3-2e01-4f9f-81b2-2d8ad0910611 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.730205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.730992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.731337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.731674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.732582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.734318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.746298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1022/2038] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:44.750506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.760953 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330dae4-7e8d-45ad-9801-76a84d505f1a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.766033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb880-e532-42e4-adc2-4026abce60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.766744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb880-e532-42e4-adc2-4026abce60b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.767058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb880-e532-42e4-adc2-4026abce60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.767400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb880-e532-42e4-adc2-4026abce60b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.768215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb880-e532-42e4-adc2-4026abce60b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.769919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb880-e532-42e4-adc2-4026abce60b2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.780345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1017/2039] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:44.784551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:44.795107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa8708-07bc-4987-9d20-fa9e7625fbe7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:44.799706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:44.800657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.800966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.801239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] PATH_INFO: `/v3/projects/40d2e9461e3c4c1bb0015841c8a1568c/users/812e7b19af13437dac7507e64f169757/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.816475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d2e9461e3c4c1bb0015841c8a1568c, user_id=812e7b19af13437dac7507e64f169757, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:44.819964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:44.833842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1023/2040] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:44 2022] PUT /identity/v3/projects/40d2e9461e3c4c1bb0015841c8a1568c/users/812e7b19af13437dac7507e64f169757/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:44.844211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:44.844502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:44.844800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:44.871998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] MFA Rules not processed for user `812e7b19af13437dac7507e64f169757`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:44.873350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:44.937598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1018/2041] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:44.942361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.003175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ead6f-efee-413a-af62-c849acac5282 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.007742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.008409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.008683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.008985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.009706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.011623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.039817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1024/2042] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:44 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:45.041353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.052054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdab97-32f7-46cb-8cec-2e89e5599a31 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.111254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.111921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.112217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.112486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.113284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.115441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.135969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1019/2043] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:45 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:45.139908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.152524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4f36f-b898-47ce-9425-3b8babbae132 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.157764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.158433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.158673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.158991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.159817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.161478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.172656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1025/2044] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:45.176760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.188102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4cfa-fa05-41eb-9d3f-757fc9c994d1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.206225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.207216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.207924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.207924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] PATH_INFO: `/v3/projects/577f03474c9f4ca391c24e25a2f49c0a/users/ddc7638fe9204e779b243ef1d7c491e0/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.223987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] RBAC: Authorizing `identity:create_grant(project_id=577f03474c9f4ca391c24e25a2f49c0a, user_id=ddc7638fe9204e779b243ef1d7c491e0, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.226751 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.242366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1020/2045] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:45 2022] PUT /identity/v3/projects/577f03474c9f4ca391c24e25a2f49c0a/users/ddc7638fe9204e779b243ef1d7c491e0/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:45.246290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.261644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c265d-7208-4d18-9c06-7a71dbe19e39 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.319328 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.320010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.320344 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.320605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.321396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.323109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.333727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1026/2046] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:45.337928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.345585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.347404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:45.348524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0884-88b4-4741-aaf1-79393452864a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.353641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932040b2-96e3-40a5-8d6b-70bf182057e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.354536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932040b2-96e3-40a5-8d6b-70bf182057e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.354806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932040b2-96e3-40a5-8d6b-70bf182057e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.355078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932040b2-96e3-40a5-8d6b-70bf182057e6 admin admin] PATH_INFO: `/v3/projects/577f03474c9f4ca391c24e25a2f49c0a/users/ddc7638fe9204e779b243ef1d7c491e0/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.357207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932040b2-96e3-40a5-8d6b-70bf182057e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577f03474c9f4ca391c24e25a2f49c0a, user_id=ddc7638fe9204e779b243ef1d7c491e0, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.359947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932040b2-96e3-40a5-8d6b-70bf182057e6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.360057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6153-7e3d-4a71-8670-3170d45fc6dc admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.366933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.367816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.368101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.368377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] PATH_INFO: `/v3/users/d585e8467a1a48d5891952e3ba34505e` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.369667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d585e8467a1a48d5891952e3ba34505e)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.371910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.372791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1021/2047] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:45 2022] PUT /identity/v3/projects/577f03474c9f4ca391c24e25a2f49c0a/users/ddc7638fe9204e779b243ef1d7c491e0/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:45.382743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.383091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.383441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.411830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] MFA Rules not processed for user `ddc7638fe9204e779b243ef1d7c491e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:45.413164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:45.434460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd585e8467a1a48d5891952e3ba34505e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:45.435185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd585e8467a1a48d5891952e3ba34505e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:45.443595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd585e8467a1a48d5891952e3ba34505e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:45.461929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd585e8467a1a48d5891952e3ba34505e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:45.471279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ba53a89-99f4-4653-8351-530f9dcd1452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd585e8467a1a48d5891952e3ba34505e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:45.477959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1027/2048] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:45 2022] DELETE /identity/v3/users/d585e8467a1a48d5891952e3ba34505e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:45.482957 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.483346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.483702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.490431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1022/2049] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:45.501185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.502362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:45.502785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:45.503571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:45.566507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aef2e2-5c74-4601-b18e-bfff287c55ca None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.567353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1028/2050] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:45.577220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:45.578721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:45.627737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.628438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.628746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.629019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.638084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb81d2-4eca-47d8-94a6-e88e827f8a04 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:45.645390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:45.647520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:45.647886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:45.648187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:45.658790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.661413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.675670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1029/2051] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:45.699291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:45.700690 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:45.711037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1023/2052] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:46.046430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.057305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c069-7046-406d-acbd-04b03e0d3621 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.062068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc7638fe9204e779b243ef1d7c491e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f03474c9f4ca391c24e25a2f49c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.062736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.063016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.063290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.064201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:46.064509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.066224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.082628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1030/2053] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:46.083762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.093917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec78f84-56e4-4086-9a08-6bac465a6186 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.098830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc7638fe9204e779b243ef1d7c491e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f03474c9f4ca391c24e25a2f49c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.099520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.099801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.100105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.100945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.102858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.134330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1024/2054] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:46 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:46.135543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.146042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ff14a-aac6-49c9-a7f4-5ece58680980 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.210900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc7638fe9204e779b243ef1d7c491e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f03474c9f4ca391c24e25a2f49c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.211574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.211847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.212119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.212919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:46.213226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.214838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.227844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1031/2055] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:46.269456 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.281025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6f97-3cba-46b9-9a1b-d358c7de9884 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.285995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc7638fe9204e779b243ef1d7c491e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f03474c9f4ca391c24e25a2f49c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.287038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.287422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.287790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] PATH_INFO: `/v3/projects/a899f7ffeb064ac88fff730d00ddbe0a` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.289140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a899f7ffeb064ac88fff730d00ddbe0a)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.291421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.354919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a899f7ffeb064ac88fff730d00ddbe0a', 'request_id': 'req-b8296c8f-1643-439c-bef6-5e394f18847d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.369314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a899f7ffeb064ac88fff730d00ddbe0a', 'request_id': 'req-b8296c8f-1643-439c-bef6-5e394f18847d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.376883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a899f7ffeb064ac88fff730d00ddbe0a', 'request_id': 'req-b8296c8f-1643-439c-bef6-5e394f18847d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.388094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] The token cache is being invalidate because project a899f7ffeb064ac88fff730d00ddbe0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:46.388385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.389069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.390711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1025/2056] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:46 2022] DELETE /identity/v3/projects/a899f7ffeb064ac88fff730d00ddbe0a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:46.396475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.405554 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:46.478799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337894-2272-4a9d-8edd-f16a44c607d4 tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.535129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.536008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.536295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.536569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] PATH_INFO: `/v3/projects/fd1e7d9262af41fba0eb1f2f31d1047c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.537813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1e7d9262af41fba0eb1f2f31d1047c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.539780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.581336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.582977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:46.589675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1e7d9262af41fba0eb1f2f31d1047c', 'request_id': 'req-688a1171-61a4-427c-b345-7856afe729ce'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.595728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1e7d9262af41fba0eb1f2f31d1047c', 'request_id': 'req-688a1171-61a4-427c-b345-7856afe729ce'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.601640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296c8f-1643-439c-bef6-5e394f18847d tempest-VolumeQuotaClassesTest-1552713247 tempest-VolumeQuotaClassesTest-1552713247-project-admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.602283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1e7d9262af41fba0eb1f2f31d1047c', 'request_id': 'req-688a1171-61a4-427c-b345-7856afe729ce'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.617348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] The token cache is being invalidate because project fd1e7d9262af41fba0eb1f2f31d1047c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:46.617871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.618538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.620095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1032/2057] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:46 2022] DELETE /identity/v3/projects/fd1e7d9262af41fba0eb1f2f31d1047c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:46.624399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.625866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:46.670364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.671241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.671514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.671785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] PATH_INFO: `/v3/users/812e7b19af13437dac7507e64f169757` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.673062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=812e7b19af13437dac7507e64f169757)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.675027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.692088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1171-61a4-427c-b345-7856afe729ce admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.699671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.701013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.701238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.701564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] PATH_INFO: `/v3/users/c62f4753f6f443fc870074f7c1048ffe` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.703327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62f4753f6f443fc870074f7c1048ffe)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:46.706000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:46.723653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812e7b19af13437dac7507e64f169757'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.734048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812e7b19af13437dac7507e64f169757'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.735135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812e7b19af13437dac7507e64f169757'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.742773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812e7b19af13437dac7507e64f169757'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.755101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8c434236-1189-4e55-823d-fbafdd237745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812e7b19af13437dac7507e64f169757'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.757181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62f4753f6f443fc870074f7c1048ffe'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.757883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62f4753f6f443fc870074f7c1048ffe'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.764821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1026/2058] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:46 2022] DELETE /identity/v3/users/812e7b19af13437dac7507e64f169757 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:46.764985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62f4753f6f443fc870074f7c1048ffe'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.767705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.768067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.768305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:46.778648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62f4753f6f443fc870074f7c1048ffe'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.786153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62f4753f6f443fc870074f7c1048ffe'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:46.786289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:46.787518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:46.792762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1033/2059] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:46 2022] DELETE /identity/v3/users/c62f4753f6f443fc870074f7c1048ffe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:46.846284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1027/2060] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:46.857714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:46.859359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:46.918431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a716-e011-4b4d-8229-6ff3fa839d18 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:46.922855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2a4c-e9fa-4451-b0a1-1c13b15701ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:46.923620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2a4c-e9fa-4451-b0a1-1c13b15701ca service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:46.924342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2a4c-e9fa-4451-b0a1-1c13b15701ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:46.924342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2a4c-e9fa-4451-b0a1-1c13b15701ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.013102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e2a4c-e9fa-4451-b0a1-1c13b15701ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.015067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e2a4c-e9fa-4451-b0a1-1c13b15701ca service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.026310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1034/2061] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:47.137705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.139408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.175503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291af0-fd92-4baa-bb5f-bdd946484666 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.181024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.182054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.182341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.182617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] PATH_INFO: `/v3/projects/8ad215fd991e470ea2f99b34c0d9d7f2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.183874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad215fd991e470ea2f99b34c0d9d7f2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.185847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.242100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad215fd991e470ea2f99b34c0d9d7f2', 'request_id': 'req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.253398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad215fd991e470ea2f99b34c0d9d7f2', 'request_id': 'req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.261083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad215fd991e470ea2f99b34c0d9d7f2', 'request_id': 'req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.274172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] The token cache is being invalidate because project 8ad215fd991e470ea2f99b34c0d9d7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:47.274467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.275134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.277655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1028/2062] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:47 2022] DELETE /identity/v3/projects/8ad215fd991e470ea2f99b34c0d9d7f2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:47.283151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc203-8848-4edf-a549-ecc19793b671 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.283438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc203-8848-4edf-a549-ecc19793b671 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.283714 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc203-8848-4edf-a549-ecc19793b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.308922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-aa6fc203-8848-4edf-a549-ecc19793b671 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:47.310140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-aa6fc203-8848-4edf-a549-ecc19793b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.322683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.324109 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.398165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1035/2063] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:47.414414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.424604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.428666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.443137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41fcc9-3858-4e81-b864-5310bd6c6b6f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.450775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.452684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.453139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.453427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] PATH_INFO: `/v3/projects/40d2e9461e3c4c1bb0015841c8a1568c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.454717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d2e9461e3c4c1bb0015841c8a1568c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.456705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.469237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:47.470438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.496440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1036/2064] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:47.497872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.511549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb9124-420f-4e9c-addc-5b27e9a49d5f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.514084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d2e9461e3c4c1bb0015841c8a1568c', 'request_id': 'req-6dd1732a-5765-41ab-b98a-1d902f35e7ac'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.524392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d2e9461e3c4c1bb0015841c8a1568c', 'request_id': 'req-6dd1732a-5765-41ab-b98a-1d902f35e7ac'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.534023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d2e9461e3c4c1bb0015841c8a1568c', 'request_id': 'req-6dd1732a-5765-41ab-b98a-1d902f35e7ac'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.548406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] The token cache is being invalidate because project 40d2e9461e3c4c1bb0015841c8a1568c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:47.548763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.550100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.551991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1029/2065] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:47 2022] DELETE /identity/v3/projects/40d2e9461e3c4c1bb0015841c8a1568c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:47.556525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.557924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.586500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.587186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.587743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.588162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.589412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:47.589717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.592013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.611334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1037/2066] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:47.615872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.618259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.634644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db46e-277a-4954-8850-024681bd6f07 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.640961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1732a-5765-41ab-b98a-1d902f35e7ac admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.643021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.644206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.644596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.645020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.645866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.648039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.648967 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.651348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.652242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.652706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] PATH_INFO: `/v3/users/ddc7638fe9204e779b243ef1d7c491e0` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.654193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc7638fe9204e779b243ef1d7c491e0)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.656805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.684761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1038/2067] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:47 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:47.687510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.722693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc7638fe9204e779b243ef1d7c491e0'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.732543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc7638fe9204e779b243ef1d7c491e0'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.734135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc7638fe9204e779b243ef1d7c491e0'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.748645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc7638fe9204e779b243ef1d7c491e0'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.762376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc7638fe9204e779b243ef1d7c491e0'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:47.763215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814d0b-4ab5-4ecc-9cdd-0d18bbe567c3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.768084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.768981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.769363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.772400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.772528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1030/2068] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:47 2022] DELETE /identity/v3/users/ddc7638fe9204e779b243ef1d7c491e0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:47.772631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.772906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.794823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1039/2069] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:47 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:47.799097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.800788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:47.868066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a06e6a-cc75-4292-a18e-e04a6c6eae1f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.873500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.874209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.874487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.874795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.875504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.877893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.888971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1031/2070] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:47.892878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.903429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d10bb-1df9-496d-abda-bded82d03eb3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.908331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c37ef6-1c96-40f4-b847-627c0f470ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.909007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c37ef6-1c96-40f4-b847-627c0f470ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.909251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c37ef6-1c96-40f4-b847-627c0f470ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.909525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c37ef6-1c96-40f4-b847-627c0f470ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.910273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c37ef6-1c96-40f4-b847-627c0f470ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.911892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c37ef6-1c96-40f4-b847-627c0f470ccc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.924965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1040/2071] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:47.926859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:47.937829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29611dda-d359-4b44-a396-9ddc76fe5d19 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:47.942537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:47.943422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.943732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.944020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] PATH_INFO: `/v3/projects/b8b36e89694b4657b9c349d5b95925b2/users/306faeb029de4053acc5ef3c82125302/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:47.961020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b36e89694b4657b9c349d5b95925b2, user_id=306faeb029de4053acc5ef3c82125302, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:47.964310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:47.981040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1032/2072] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:47 2022] PUT /identity/v3/projects/b8b36e89694b4657b9c349d5b95925b2/users/306faeb029de4053acc5ef3c82125302/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:47.991746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:47.992278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:47.992648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.020886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] MFA Rules not processed for user `306faeb029de4053acc5ef3c82125302`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:48.022329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.055546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.057564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.100282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1041/2073] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:48.104936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.138995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbec92b-19d1-47f4-9155-571e365e3b95 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.143809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.144672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.144988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.145265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] PATH_INFO: `/v3/projects/577f03474c9f4ca391c24e25a2f49c0a` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.146465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=577f03474c9f4ca391c24e25a2f49c0a)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.148378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.163558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715621-15b5-42ba-b7d5-c2b760078881 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.168261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.169083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.169424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.169755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.170536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.172514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.205513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1042/2074] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:48.207330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577f03474c9f4ca391c24e25a2f49c0a', 'request_id': 'req-0c3412e4-173c-47b6-a272-be8413519beb'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:48.209364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.215206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577f03474c9f4ca391c24e25a2f49c0a', 'request_id': 'req-0c3412e4-173c-47b6-a272-be8413519beb'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:48.222677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577f03474c9f4ca391c24e25a2f49c0a', 'request_id': 'req-0c3412e4-173c-47b6-a272-be8413519beb'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:48.235176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] The token cache is being invalidate because project 577f03474c9f4ca391c24e25a2f49c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:48.235588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:48.236302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0c3412e4-173c-47b6-a272-be8413519beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:48.242355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1033/2075] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:48 2022] DELETE /identity/v3/projects/577f03474c9f4ca391c24e25a2f49c0a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:48.243789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4e2e-7e43-4056-ad04-eb703a6bd1d0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.244078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4e2e-7e43-4056-ad04-eb703a6bd1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.244526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4e2e-7e43-4056-ad04-eb703a6bd1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.264870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-45bf4e2e-7e43-4056-ad04-eb703a6bd1d0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:48.266160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-45bf4e2e-7e43-4056-ad04-eb703a6bd1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.289793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f19a5f-47a0-4e96-9579-984017641a01 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.295273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.295642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.295906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.296173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.297007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.299221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.327875 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1043/2076] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:48.329164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.331408 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.338738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1034/2077] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:48.348461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.348902 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.349274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.349442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396f7e5-3378-47f1-9269-16d4f7cc5fd8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.359257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.360109 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.360397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.360678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.361447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.363172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.376965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1044/2078] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:48.382061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:48.383462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.385545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.392090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1035/2079] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:48.396257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2b46-b17b-45ed-b38c-579a19e254a9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.397013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.405736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.406627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.406900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.407143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768f5e0-0971-47ee-bf99-058e7e20515f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.407250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] PATH_INFO: `/v3/projects/5804b9c9dfab4209904aedeb7fd7a2e8/users/adbc00ee03d04aa1ae67234b7544237e/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.413768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.414433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.415089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.415089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.416066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:48.416395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.418579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.425062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5804b9c9dfab4209904aedeb7fd7a2e8, user_id=adbc00ee03d04aa1ae67234b7544237e, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.428226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.433175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1036/2080] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:48.438651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.442485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1045/2081] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:48 2022] PUT /identity/v3/projects/5804b9c9dfab4209904aedeb7fd7a2e8/users/adbc00ee03d04aa1ae67234b7544237e/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:48.446028 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.448479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc485-95d9-44cb-9c81-bd954cb078eb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.505417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.506229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.506584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.506945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.507716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.509821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.511182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193c43-8855-4f4a-b052-dbdb19cc1843 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.516128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.516828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.517121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.517383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.518287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.519962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.532765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1046/2082] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:48.535103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.546684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1037/2083] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:48.547706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.551073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3026e5-1869-491b-a326-8675cd36ac2a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.620085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ff7e9-d3e7-4a91-94d3-890acae4362c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.629671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169fc0d-cc9e-47aa-badd-e07f5106a41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.630352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169fc0d-cc9e-47aa-badd-e07f5106a41f admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.630629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169fc0d-cc9e-47aa-badd-e07f5106a41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.630899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169fc0d-cc9e-47aa-badd-e07f5106a41f admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.631758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169fc0d-cc9e-47aa-badd-e07f5106a41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.633946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169fc0d-cc9e-47aa-badd-e07f5106a41f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.636216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.637252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.637674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.638061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] PATH_INFO: `/v3/projects/5804b9c9dfab4209904aedeb7fd7a2e8/users/adbc00ee03d04aa1ae67234b7544237e/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.640210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5804b9c9dfab4209904aedeb7fd7a2e8, user_id=adbc00ee03d04aa1ae67234b7544237e, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.644324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.656100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1038/2085] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:48.656628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1047/2085] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:48 2022] PUT /identity/v3/projects/5804b9c9dfab4209904aedeb7fd7a2e8/users/adbc00ee03d04aa1ae67234b7544237e/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:48.661209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.671231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.671421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.672037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.702419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] MFA Rules not processed for user `adbc00ee03d04aa1ae67234b7544237e`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:48.703843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.746202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1db98-6e62-48b8-9ce4-dda4ff556777 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.751979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.752904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.753304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.753667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.754667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.757888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.773601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1048/2086] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:48.777989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.789232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a796e2-adaf-4ace-8deb-fa6a7e9c8a21 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.794640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.795560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.795965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.796375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.797458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.799286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.812298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1039/2087] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:48.820771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1049/2088] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:48.829986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.835147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:48.840945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.845602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235f8c-8542-4d30-ab0e-45dcb2cacdfe None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.854234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734cd9b-4d37-4ef0-9050-14f9ccac6650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.855144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734cd9b-4d37-4ef0-9050-14f9ccac6650 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.855420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734cd9b-4d37-4ef0-9050-14f9ccac6650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.855839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734cd9b-4d37-4ef0-9050-14f9ccac6650 admin admin] PATH_INFO: `/v3/projects/70eb6ccd1b0546969b9d8a08e6aa700f/users/6fa1bbb6d27349b689b2e5e216e1b0dc/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.878000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734cd9b-4d37-4ef0-9050-14f9ccac6650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70eb6ccd1b0546969b9d8a08e6aa700f, user_id=6fa1bbb6d27349b689b2e5e216e1b0dc, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:48.889555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734cd9b-4d37-4ef0-9050-14f9ccac6650 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:48.916921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1040/2089] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:48 2022] PUT /identity/v3/projects/70eb6ccd1b0546969b9d8a08e6aa700f/users/6fa1bbb6d27349b689b2e5e216e1b0dc/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:48.917910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f0faa-ce2e-43cb-852e-f66a2308e4be admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:48.918979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.919526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.919959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:48.948694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] MFA Rules not processed for user `6fa1bbb6d27349b689b2e5e216e1b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:48.949842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:48.973456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:48.974172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:48.974455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:48.974729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.033264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1041/2090] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:49.037077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.066735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.069072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.082987 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1050/2091] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:49.104385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7f0b2-e6cb-49d4-9f58-9d0014759921 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.110283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.111029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.111378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.111778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.112770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.118697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.152779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1042/2092] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:49 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:49.156137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.167815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0012-053d-4813-8847-808144b825b2 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.229247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.229950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.230225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.230552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.231184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.233184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.256608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1051/2093] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:49 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:49.260896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.271677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be16d3-f0d9-4a4e-8535-89e08eddcc11 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.276548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.277247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.277788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.277788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.278656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.280280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.295362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1043/2094] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:49.299188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.309565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35875-351f-4e43-8871-36475741101c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.319533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b435f-465d-498d-98db-ddace43e5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.320220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b435f-465d-498d-98db-ddace43e5729 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.320507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b435f-465d-498d-98db-ddace43e5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.320822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b435f-465d-498d-98db-ddace43e5729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.321608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b435f-465d-498d-98db-ddace43e5729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.323467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b435f-465d-498d-98db-ddace43e5729 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.334683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1052/2095] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:49.339014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.348941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a7f5-e860-4337-9f1e-106d11812a01 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.354113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.355164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.355512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.355861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] PATH_INFO: `/v3/projects/271e3142a4a44acd8f99fa19c044f4ce/users/d419bbc7ce3540498e0cbba53cf20a79/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.371135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271e3142a4a44acd8f99fa19c044f4ce, user_id=d419bbc7ce3540498e0cbba53cf20a79, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.373912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.392932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1044/2096] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:49 2022] PUT /identity/v3/projects/271e3142a4a44acd8f99fa19c044f4ce/users/d419bbc7ce3540498e0cbba53cf20a79/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:49.404323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.404613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.404935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.444232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] MFA Rules not processed for user `d419bbc7ce3540498e0cbba53cf20a79`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:49.445524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:49.505443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.527516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1053/2097] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:49.531952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.592911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0454bd-bac6-44d3-8f3c-fef923ad0d30 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.599897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.601379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.601849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.602288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] PATH_INFO: `/v3/users/306faeb029de4053acc5ef3c82125302` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.604574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306faeb029de4053acc5ef3c82125302)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.608151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.621973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74745228-823a-4beb-8621-291ca9fcfc31 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.626742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.627425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.627703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.628040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.628775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.630949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.658248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1054/2098] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:49 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:49.661181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306faeb029de4053acc5ef3c82125302'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:49.662467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.669976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306faeb029de4053acc5ef3c82125302'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:49.670859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306faeb029de4053acc5ef3c82125302'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:49.677921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306faeb029de4053acc5ef3c82125302'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:49.690962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-87e4171e-c235-4971-aaa6-ef1e26853b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306faeb029de4053acc5ef3c82125302'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:49.701001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1045/2099] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:49 2022] DELETE /identity/v3/users/306faeb029de4053acc5ef3c82125302 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:49.702552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.703023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.703440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.723313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:49.724697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:49.733985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5f3c0-5d00-472c-ade5-8e616b14f67f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.789142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1046/2100] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:49.794778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.795452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.795728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.795994 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.796691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.798655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.801829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.803245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:49.824516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1055/2101] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:49 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:49.826017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.828307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:49.841195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690521fa-d8fb-4204-873d-7ffb0fd675aa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.847091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.847909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.848180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.848594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.849232 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.851462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.862278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1056/2102] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:49.867375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.871044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679f689-992b-4e5a-9148-d6380e693cad None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.875361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.876009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.876285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.876553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.877327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287304d-40c4-4853-840e-64b8a6ecd4c4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.881943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.882803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.883080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.883355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] PATH_INFO: `/v3/projects/50c6aab7c3924bc5b4036b20fdc5d9b3/users/e417a2a55dfa4ab3a2555e56b752a5ed/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.885635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.887208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.896950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1047/2103] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:49.898213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c6aab7c3924bc5b4036b20fdc5d9b3, user_id=e417a2a55dfa4ab3a2555e56b752a5ed, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.900888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:49.914440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1057/2104] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:49 2022] PUT /identity/v3/projects/50c6aab7c3924bc5b4036b20fdc5d9b3/users/e417a2a55dfa4ab3a2555e56b752a5ed/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:49.918447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:49.928418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ed740-9703-4805-98bb-801fdb6f0f5a service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:49.990075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ad09-98b0-44d4-b83d-7d89f58521ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:49.990738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ad09-98b0-44d4-b83d-7d89f58521ee admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:49.991009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ad09-98b0-44d4-b83d-7d89f58521ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:49.991275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ad09-98b0-44d4-b83d-7d89f58521ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:49.992159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ad09-98b0-44d4-b83d-7d89f58521ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:49.993785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ad09-98b0-44d4-b83d-7d89f58521ee admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:50.008314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1048/2105] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:50.009443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:50.022192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdb9cb-3c7a-4379-a5a4-54c55f1d6318 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:50.027504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:50.029158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:50.029680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:50.030051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] PATH_INFO: `/v3/projects/50c6aab7c3924bc5b4036b20fdc5d9b3/users/e417a2a55dfa4ab3a2555e56b752a5ed/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:50.032881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c6aab7c3924bc5b4036b20fdc5d9b3, user_id=e417a2a55dfa4ab3a2555e56b752a5ed, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:50.036401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:50.060285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1058/2106] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:50 2022] PUT /identity/v3/projects/50c6aab7c3924bc5b4036b20fdc5d9b3/users/e417a2a55dfa4ab3a2555e56b752a5ed/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:50.074406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:50.074702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:50.074979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:50.104459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] MFA Rules not processed for user `e417a2a55dfa4ab3a2555e56b752a5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:50.105704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:50.171793 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1049/2107] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:50.181578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:50.183657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:50.245736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79d94-d7c0-4c1e-9002-c7b46413c8e9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:50.249481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:50.250118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:50.250393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:50.250656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:50.263688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:50.265373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:50.280807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1059/2108] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:50.304273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:50.305884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:50.408805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb493-8b9d-40be-9c2f-6b2d8324f6b6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:50.415415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:50.416645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:50.417012 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:50.417225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] PATH_INFO: `/v3/projects/b8b36e89694b4657b9c349d5b95925b2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:50.418753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b36e89694b4657b9c349d5b95925b2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:50.420702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:50.479462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b36e89694b4657b9c349d5b95925b2', 'request_id': 'req-f0810baf-ceef-4886-9abc-19f6b7f2998b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.488313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b36e89694b4657b9c349d5b95925b2', 'request_id': 'req-f0810baf-ceef-4886-9abc-19f6b7f2998b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.495887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b36e89694b4657b9c349d5b95925b2', 'request_id': 'req-f0810baf-ceef-4886-9abc-19f6b7f2998b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.509406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] The token cache is being invalidate because project b8b36e89694b4657b9c349d5b95925b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:50.510677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.511332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.513171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1050/2109] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:50 2022] DELETE /identity/v3/projects/b8b36e89694b4657b9c349d5b95925b2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:50.518592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:50.535430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ebf9-9397-483f-8f33-f80282375ea9 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:50.599606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:50.600596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:50.600999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:50.601341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] PATH_INFO: `/v3/users/adbc00ee03d04aa1ae67234b7544237e` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:50.602754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbc00ee03d04aa1ae67234b7544237e)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:50.605580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:50.656669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbc00ee03d04aa1ae67234b7544237e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.657337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbc00ee03d04aa1ae67234b7544237e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.665001 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbc00ee03d04aa1ae67234b7544237e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.677104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbc00ee03d04aa1ae67234b7544237e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.686014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbc00ee03d04aa1ae67234b7544237e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:50.693936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1060/2110] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:50 2022] DELETE /identity/v3/users/adbc00ee03d04aa1ae67234b7544237e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:50.798655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:50.800701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:50.871400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0810baf-ceef-4886-9abc-19f6b7f2998b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:50.927081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:50.927724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:50.927998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:50.928264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:50.930221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:51.000176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:51.001933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde07a-e7f9-4362-ac16-7e78ada8dea7 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:51.011367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1051/2111] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:51.232870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:51.234811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:51.329907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c586f1-82b2-44f4-8f99-26cfecb82712 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:51.343719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:51.345267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:51.347916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:51.348428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] PATH_INFO: `/v3/projects/5804b9c9dfab4209904aedeb7fd7a2e8` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:51.358008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5804b9c9dfab4209904aedeb7fd7a2e8)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:51.360309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:51.444500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5804b9c9dfab4209904aedeb7fd7a2e8', 'request_id': 'req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:51.454226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5804b9c9dfab4209904aedeb7fd7a2e8', 'request_id': 'req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:51.461896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5804b9c9dfab4209904aedeb7fd7a2e8', 'request_id': 'req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:51.483201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] The token cache is being invalidate because project 5804b9c9dfab4209904aedeb7fd7a2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:51.483474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:51.484212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6bb46ed-dfb0-4aba-88a5-a82f828cf543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:51.486365 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1061/2112] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:51 2022] DELETE /identity/v3/projects/5804b9c9dfab4209904aedeb7fd7a2e8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:51.492647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:51.492948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:51.493213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:51.516999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:51.518176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:51.625156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1052/2113] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:51.627341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:51.627881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:51.628126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:51.666558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:51.668500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:51.687221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1062/2114] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:51.689553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:51.704283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cbc1-21e2-4259-8601-88a191c8bf86 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:51.714838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:51.715560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:51.715852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:51.716124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:51.717114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:51.717448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:51.724872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:51.762722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1053/2115] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:51.767939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:51.778512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aefa8-68e8-4d6a-b722-0f2f98b814ec None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:51.790602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:51.791476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:51.791921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:51.792341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:51.793274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:51.795851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:51.855018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1063/2116] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:51 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:51.859636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:51.873624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8269a-27d4-431a-8b95-63c6ab56a256 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:51.974529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:51.974686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:51.975103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:51.975523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:51.976397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:51.978938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.012199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1054/2117] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:51 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:57:52.012980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.027326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb5718-9fdd-4051-8e32-f1cd9625f828 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.034428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.035324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.035700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.036064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.037000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.038835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.053925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1064/2118] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:52.055320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.071339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89cb13-11b5-46fe-b334-29007bd1003f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.079136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0df7fa-fb5c-4b68-96a6-25e62c1fabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.080175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0df7fa-fb5c-4b68-96a6-25e62c1fabf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.080460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0df7fa-fb5c-4b68-96a6-25e62c1fabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.080843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0df7fa-fb5c-4b68-96a6-25e62c1fabf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.081669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0df7fa-fb5c-4b68-96a6-25e62c1fabf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.083334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0df7fa-fb5c-4b68-96a6-25e62c1fabf4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.099388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1055/2119] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:52.100870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.121160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36f2b6-ee61-4c51-9b94-3216b6b8b970 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.129968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.131138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.131594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.131932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] PATH_INFO: `/v3/projects/6e8946d32ab94d36b6c14b7473cae114/users/13d4aa9d75a84079a73d52d7b83dd86f/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.149671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8946d32ab94d36b6c14b7473cae114, user_id=13d4aa9d75a84079a73d52d7b83dd86f, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.152703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.187413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1065/2120] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:52 2022] PUT /identity/v3/projects/6e8946d32ab94d36b6c14b7473cae114/users/13d4aa9d75a84079a73d52d7b83dd86f/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:52.200642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.200964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.202024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.287620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] MFA Rules not processed for user `13d4aa9d75a84079a73d52d7b83dd86f`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:52.288835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:52.377799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1056/2121] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:52.387439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.469413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95509f71-09fa-41ab-ac5c-c16ef34ca2d3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.474609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.475375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.475662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.476199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.477021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.479581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.514211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1066/2122] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:52.515297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.527040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e4abb-548f-4b23-85b1-4e8e9b4606f1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.589730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.590376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.590672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.591020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.591840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.594372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.616822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1057/2123] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:52 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:52.620692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.632678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc47cf-a857-4831-99dd-96a4a5d0c4e1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.638912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.639620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.640141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.640357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.641146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.642836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.655186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1067/2124] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:57:52.659496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.672357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c09fc-f280-43c5-b09e-4df49d1c43d4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.677106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.678091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.678369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.678636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] PATH_INFO: `/v3/projects/77ad017466464e90a6bf618fa99adae3/users/488fcde039694e2e93c233c68a22b62d/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.698919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ad017466464e90a6bf618fa99adae3, user_id=488fcde039694e2e93c233c68a22b62d, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.701672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.718890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1058/2125] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:52 2022] PUT /identity/v3/projects/77ad017466464e90a6bf618fa99adae3/users/488fcde039694e2e93c233c68a22b62d/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:52.723065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.749421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c152-b740-4b53-b4d3-4b7f50ab7f75 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.881716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9769ca-832b-499e-9836-620fef9a0887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.882564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9769ca-832b-499e-9836-620fef9a0887 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.882965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9769ca-832b-499e-9836-620fef9a0887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.883336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9769ca-832b-499e-9836-620fef9a0887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.884295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9769ca-832b-499e-9836-620fef9a0887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.886160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9769ca-832b-499e-9836-620fef9a0887 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.905243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1068/2126] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:52.909506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:52.931106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5162-6c0d-4ef3-b1b8-8d17b86a5f4e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:52.938885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:52.939880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.940192 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.940476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] PATH_INFO: `/v3/projects/77ad017466464e90a6bf618fa99adae3/users/488fcde039694e2e93c233c68a22b62d/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:52.942684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ad017466464e90a6bf618fa99adae3, user_id=488fcde039694e2e93c233c68a22b62d, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:52.946138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:52.959642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1059/2127] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:52 2022] PUT /identity/v3/projects/77ad017466464e90a6bf618fa99adae3/users/488fcde039694e2e93c233c68a22b62d/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:52.970118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:52.970405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:52.970685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:53.000143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] MFA Rules not processed for user `488fcde039694e2e93c233c68a22b62d`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:53.001680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:53.075242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1069/2128] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:53.090196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:53.091982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:53.152746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfc0e-0243-4d1c-a399-8e88c98891ff admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:53.157461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319f69-a894-4d44-84fc-aaabb85ab26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:53.158232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319f69-a894-4d44-84fc-aaabb85ab26d service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:53.158614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319f69-a894-4d44-84fc-aaabb85ab26d service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:53.159024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319f69-a894-4d44-84fc-aaabb85ab26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:53.169630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319f69-a894-4d44-84fc-aaabb85ab26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:53.173544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319f69-a894-4d44-84fc-aaabb85ab26d service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:53.186561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1060/2129] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:53.294964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:53.307371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d4fed-cc46-4cd5-8b9c-7c9368d08e2e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:53.317392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448859-3567-49e9-aa4d-1d9991130ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:53.318058 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448859-3567-49e9-aa4d-1d9991130ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:53.318339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448859-3567-49e9-aa4d-1d9991130ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:53.318610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448859-3567-49e9-aa4d-1d9991130ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:53.421269 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448859-3567-49e9-aa4d-1d9991130ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:53.423618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448859-3567-49e9-aa4d-1d9991130ea1 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:53.447426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1070/2130] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:53.910298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:53.910804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:53.910982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:53.929839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] MFA Rules not processed for user `3754bf46af13470faf170277d5086e88`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:53.931492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:54.017197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1061/2131] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:54.451257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:54.451829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:54.451829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:54.470271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:54.471509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:54.531547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1071/2132] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:54.585197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:54.585627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:54.686111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e813-9bc4-479c-82bf-2ca4d490300b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:54.698223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f7b9-8772-4579-88e4-a69c99c46ab4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:54.699499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f7b9-8772-4579-88e4-a69c99c46ab4 service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:54.699949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f7b9-8772-4579-88e4-a69c99c46ab4 service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:54.700580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f7b9-8772-4579-88e4-a69c99c46ab4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:54.717078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f7b9-8772-4579-88e4-a69c99c46ab4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:54.719030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f7b9-8772-4579-88e4-a69c99c46ab4 service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:54.737079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1062/2133] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:55.470390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:55.471915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:55.499613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f573-9e32-4716-b012-2d542a4ea2a2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:55.506366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:55.512139 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:55.512661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:55.514468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:55.516852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:55.581317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b048e-2a19-44f2-9548-4427b6dcebbc None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:55.581822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b048e-2a19-44f2-9548-4427b6dcebbc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:55.581937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b048e-2a19-44f2-9548-4427b6dcebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:55.605821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:55.606443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:55.615527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1072/2134] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:55.616887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-303b048e-2a19-44f2-9548-4427b6dcebbc None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:55.618110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-303b048e-2a19-44f2-9548-4427b6dcebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:55.625350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1063/2135] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 3 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:55.649095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:55.668585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607b6c-fdd2-4f92-afb6-e0dbab9166ef service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:55.674885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:55.675557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:55.675836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:55.676110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:55.684591 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:55.686222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:55.696764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1073/2136] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:57:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:55.961195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:55.961630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:55.961978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:55.981164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:55.982367 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:55.989681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1064/2137] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:56.003492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:56.014863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394263a-415f-4e0f-9193-3488ca225cef service swift] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:56.020497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b23f0d-b235-4df7-832a-48029ff4fd68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:56.021986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b23f0d-b235-4df7-832a-48029ff4fd68 service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.022671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b23f0d-b235-4df7-832a-48029ff4fd68 service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.023356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b23f0d-b235-4df7-832a-48029ff4fd68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.034969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b23f0d-b235-4df7-832a-48029ff4fd68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:56.036971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b23f0d-b235-4df7-832a-48029ff4fd68 service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:56.046141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1074/2138] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:57:56.231158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:56.322382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5e7a-c49a-40c0-bd4c-ac6bd492d7df None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:56.327248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:56.328231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.328595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.329111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] PATH_INFO: `/v3/users/13d4aa9d75a84079a73d52d7b83dd86f` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.331082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d4aa9d75a84079a73d52d7b83dd86f)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:56.333909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:56.394987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d4aa9d75a84079a73d52d7b83dd86f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:56.408453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d4aa9d75a84079a73d52d7b83dd86f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:56.409875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d4aa9d75a84079a73d52d7b83dd86f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:56.423389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d4aa9d75a84079a73d52d7b83dd86f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:56.441122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d4aa9d75a84079a73d52d7b83dd86f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:56.449863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1065/2139] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:56 2022] DELETE /identity/v3/users/13d4aa9d75a84079a73d52d7b83dd86f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:56.455663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28d0e-daa0-46e7-8d92-783c200ca81a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.455955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28d0e-daa0-46e7-8d92-783c200ca81a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.456520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28d0e-daa0-46e7-8d92-783c200ca81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.485350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b4e28d0e-daa0-46e7-8d92-783c200ca81a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:56.486636 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b4e28d0e-daa0-46e7-8d92-783c200ca81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:56.612668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1075/2140] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:56.656184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:56.660031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:56.670061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.670061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.670061 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.714868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:56.718066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:56.755011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ae22-86cd-4b72-9b6d-b1580140fc3f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:56.759341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e0ad-da0b-410b-8fb9-6fddd0453261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:56.759788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e0ad-da0b-410b-8fb9-6fddd0453261 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.760390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e0ad-da0b-410b-8fb9-6fddd0453261 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.760841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e0ad-da0b-410b-8fb9-6fddd0453261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.785894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e0ad-da0b-410b-8fb9-6fddd0453261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:56.787376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e0ad-da0b-410b-8fb9-6fddd0453261 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:56.800268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1076/2141] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 3 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:56.803520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1066/2142] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:57:56.826443 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:56.828483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:56.928471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11319-e05d-414c-b48c-5b7c9b7825c2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:56.944172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.944471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.944781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.956466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:56.958415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:56.958697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:56.961877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:56.979380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] MFA Rules not processed for user `087b5f4f3891413b8b7fa727768c09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:56.980921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:56.995098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:56.997357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:57.047941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1077/2143] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:57.048648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1067/2144] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:57.801332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:57.803246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:57.832805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:57.834240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:57.841323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d988f-9831-42ee-b7ed-d266e536d0e3 service swift] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:57.856455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:57.858685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9e38-93b8-46bf-ba9d-362069eafb69 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:57.863947 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:57.864250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:57.864511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] PATH_INFO: `/v3/users/3b69c633ad9a496f924f8f2479eea06d` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:57.871710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:57.872324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b69c633ad9a496f924f8f2479eea06d)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:57.872593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:57.873051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:57.873475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] PATH_INFO: `/v3/projects/6e8946d32ab94d36b6c14b7473cae114` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:57.874901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8946d32ab94d36b6c14b7473cae114)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:57.875517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:57.877215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:57.975685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8946d32ab94d36b6c14b7473cae114', 'request_id': 'req-992e65e2-aad7-42db-abdf-1827bf99416e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:57.989253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b69c633ad9a496f924f8f2479eea06d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:57.991481 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b69c633ad9a496f924f8f2479eea06d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.008487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8946d32ab94d36b6c14b7473cae114', 'request_id': 'req-992e65e2-aad7-42db-abdf-1827bf99416e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.020329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8946d32ab94d36b6c14b7473cae114', 'request_id': 'req-992e65e2-aad7-42db-abdf-1827bf99416e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.023334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b69c633ad9a496f924f8f2479eea06d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.052117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] The token cache is being invalidate because project 6e8946d32ab94d36b6c14b7473cae114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:58.052542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.053813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.058975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1068/2145] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:57 2022] DELETE /identity/v3/projects/6e8946d32ab94d36b6c14b7473cae114 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:58.064332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:58.077519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:58.081533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b69c633ad9a496f924f8f2479eea06d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.101088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b69c633ad9a496f924f8f2479eea06d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.113500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1078/2146] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:57 2022] DELETE /identity/v3/users/3b69c633ad9a496f924f8f2479eea06d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:58.237971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e65e2-aad7-42db-abdf-1827bf99416e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:58.393518 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:58.397755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:58.399879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:58.401644 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] PATH_INFO: `/v3/users/488fcde039694e2e93c233c68a22b62d` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:58.405813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=488fcde039694e2e93c233c68a22b62d)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:58.410015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:58.530543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488fcde039694e2e93c233c68a22b62d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.543946 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488fcde039694e2e93c233c68a22b62d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.544516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488fcde039694e2e93c233c68a22b62d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.565311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488fcde039694e2e93c233c68a22b62d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.581128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:58.583437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:58.597307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488fcde039694e2e93c233c68a22b62d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.607592 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1069/2147] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:58 2022] DELETE /identity/v3/users/488fcde039694e2e93c233c68a22b62d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:58.609351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0060e5-fe9e-407f-8118-2aa558371ba0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:58.641542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:58.643316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:58.708613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:58.709558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:58.710154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:58.710607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] PATH_INFO: `/v3/users/6fa1bbb6d27349b689b2e5e216e1b0dc` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:58.714922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa1bbb6d27349b689b2e5e216e1b0dc)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:58.718110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:58.788435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1aba6-c008-46b3-8794-c9822abaa68f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:58.795326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:58.796317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:58.796602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:58.797083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] PATH_INFO: `/v3/projects/a2f534df59e149f8b14cd7406f932b2d` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:58.799390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f534df59e149f8b14cd7406f932b2d)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:58.802477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:58.828879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa1bbb6d27349b689b2e5e216e1b0dc'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.830197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa1bbb6d27349b689b2e5e216e1b0dc'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.839074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa1bbb6d27349b689b2e5e216e1b0dc'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.855998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa1bbb6d27349b689b2e5e216e1b0dc'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.870314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b13e7231-5fbd-4741-9f13-a8d7ccfc87e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa1bbb6d27349b689b2e5e216e1b0dc'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.878964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1079/2148] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:58 2022] DELETE /identity/v3/users/6fa1bbb6d27349b689b2e5e216e1b0dc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:58.884017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:58.884477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:58.884923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:58.903406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f534df59e149f8b14cd7406f932b2d', 'request_id': 'req-e239c247-2cdc-4c55-bf05-8991075f4dc7'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.905404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:58.906726 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:58.913058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f534df59e149f8b14cd7406f932b2d', 'request_id': 'req-e239c247-2cdc-4c55-bf05-8991075f4dc7'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.919713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f534df59e149f8b14cd7406f932b2d', 'request_id': 'req-e239c247-2cdc-4c55-bf05-8991075f4dc7'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.930996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] The token cache is being invalidate because project a2f534df59e149f8b14cd7406f932b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:58.931278 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.932435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-e239c247-2cdc-4c55-bf05-8991075f4dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:58.939305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1070/2149] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:58 2022] DELETE /identity/v3/projects/a2f534df59e149f8b14cd7406f932b2d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:57:58.941191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9a916-c7ab-4e73-b590-d28cbc0045c3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:58.941626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9a916-c7ab-4e73-b590-d28cbc0045c3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:58.942038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9a916-c7ab-4e73-b590-d28cbc0045c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:58.968434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-afc9a916-c7ab-4e73-b590-d28cbc0045c3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:58.969837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-afc9a916-c7ab-4e73-b590-d28cbc0045c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:58.982756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1080/2150] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:59.003081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.004634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.096075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1071/2151] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:59.105276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.105637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.105983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.107801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5927274-ef1f-4b60-a4c0-e932e895a449 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.116749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.117628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.118104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.119546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.136568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.138485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:59.139829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.140217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.154143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1072/2152] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:59.158616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.161123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1081/2153] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:57:59.168832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.170440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.182102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f1f3-0fe2-4fee-8f44-8c051ca96bbe None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.184490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1e1f7-0543-4826-addb-d1ce0f54c48e service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.190215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.191686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.192105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.192523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] PATH_INFO: `/v3/projects/77ad017466464e90a6bf618fa99adae3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.193844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ad017466464e90a6bf618fa99adae3)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.196453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.198424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.199104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.199377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.199641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.200541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:59.201042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.205074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.222806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1073/2154] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:57:59.223930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.236560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec97d5-c207-4549-939e-b745c2051c5b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.243474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.244431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.244919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.245892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.246813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.250651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.267363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ad017466464e90a6bf618fa99adae3', 'request_id': 'req-92f4cde1-384c-423c-a4f4-3167aec89b17'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:59.275380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ad017466464e90a6bf618fa99adae3', 'request_id': 'req-92f4cde1-384c-423c-a4f4-3167aec89b17'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:59.287397 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ad017466464e90a6bf618fa99adae3', 'request_id': 'req-92f4cde1-384c-423c-a4f4-3167aec89b17'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:59.295682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1074/2155] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:59.306884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] The token cache is being invalidate because project 77ad017466464e90a6bf618fa99adae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:57:59.307176 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:59.307839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-92f4cde1-384c-423c-a4f4-3167aec89b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:57:59.309465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1082/2156] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:57:59 2022] DELETE /identity/v3/projects/77ad017466464e90a6bf618fa99adae3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:59.313904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.315959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30bf3-3142-441c-ab23-9f538b17767e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.316249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30bf3-3142-441c-ab23-9f538b17767e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.316522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30bf3-3142-441c-ab23-9f538b17767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.320756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.353311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-06e30bf3-3142-441c-ab23-9f538b17767e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:59.354276 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-06e30bf3-3142-441c-ab23-9f538b17767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.473796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1083/2157] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:59.474025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b6198-083c-4e61-900b-9723f1f9aa09 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.489591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.490575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.491181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.491311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.491660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.493199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.494316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.495304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.496117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.535053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1075/2158] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:59.539741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.556660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:59.557207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74308a7-35c3-41b3-9b91-5299357b8903 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.558552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.572162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.572806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.573070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.573308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1084/2159] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:57:59.573707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.574544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.576209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.577624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.589621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eb229-13d0-4a06-804d-fd7704f2a17e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.596220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.597353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.597872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.598441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.602191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1076/2160] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:59.603388 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:57:59.603941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.604195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.606458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.617827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6e5de-f6a2-453f-aba1-6fe8d4dce713 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.620511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1085/2161] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:57:59.624668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.626990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.628114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.628685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.629158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.630070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.632024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.640662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812e3fc-8263-46d9-8b14-3aa3b8c3da05 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.646726 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1077/2162] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:59.651151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.652885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.653642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.654007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.654865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.655842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.658228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.664219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b284a-b108-48a8-ba2b-837e3199b09f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.671549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004852b-1cec-44b1-8cb3-97a91822e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.672904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004852b-1cec-44b1-8cb3-97a91822e7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.673332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004852b-1cec-44b1-8cb3-97a91822e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.673744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004852b-1cec-44b1-8cb3-97a91822e7bc admin admin] PATH_INFO: `/v3/projects/e8467ff017574f36b1c31db5579a56ce/users/aa4fbbf421f34df6b34b27f3ee5247b1/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.692133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004852b-1cec-44b1-8cb3-97a91822e7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8467ff017574f36b1c31db5579a56ce, user_id=aa4fbbf421f34df6b34b27f3ee5247b1, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.694964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004852b-1cec-44b1-8cb3-97a91822e7bc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.703514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1086/2163] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:59.709192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.716411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1078/2164] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:57:59 2022] PUT /identity/v3/projects/e8467ff017574f36b1c31db5579a56ce/users/aa4fbbf421f34df6b34b27f3ee5247b1/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:57:59.721391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.722296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.722626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.743259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:57:59.744542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.786954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ee70-92f0-436f-af6d-e154282a4998 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.825995 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1079/2165] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:57:59.848843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.850520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.858599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.860291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.860865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.861334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.862778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.865651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.903038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1087/2166] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:57:59 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:57:59.904292 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.917166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca2703-ed59-42bd-a02b-aea7bccec8c8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.923105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.924756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.925569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.925569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.926611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.928566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.942108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1088/2167] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:59.951595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.963383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cee171-ac00-407f-8b3c-677bbc2fb56b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.969857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.970691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.971007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.971744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:57:59.972391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:57:59.974774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:57:59.991148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ab10-f7ce-460b-ae14-bf6256e706a6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:57:59.993010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1089/2168] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:57:59.994122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:57:59.996529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:57:59.997852 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:57:59.998804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:57:59.999400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:57:59.999935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.011207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.012658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.014687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29435-6e84-44b2-aee2-f33c985abe42 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.022159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.023289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.023793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.024258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] PATH_INFO: `/v3/users/befc8b34ea6540d3991b23a58f729736` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.024375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1080/2169] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:00.025389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.026264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=befc8b34ea6540d3991b23a58f729736)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.028789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.034871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e8f18-fb96-45ae-8033-1250644541ad service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.064246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.067567 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.067567 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.067567 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] PATH_INFO: `/v3/projects/8f9e0612acf343dc9aa211d09365aad7/users/015cc8335a1240a7bd3382eba0a12448/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.108792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9e0612acf343dc9aa211d09365aad7, user_id=015cc8335a1240a7bd3382eba0a12448, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.113715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.119524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befc8b34ea6540d3991b23a58f729736'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.120494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befc8b34ea6540d3991b23a58f729736'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.130148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befc8b34ea6540d3991b23a58f729736'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.133982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1081/2170] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:00 2022] PUT /identity/v3/projects/8f9e0612acf343dc9aa211d09365aad7/users/015cc8335a1240a7bd3382eba0a12448/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:00.144234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.148053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.176456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befc8b34ea6540d3991b23a58f729736'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.189256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d5e8d42f-1f59-4b0c-b0a9-8ba0245e07d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befc8b34ea6540d3991b23a58f729736'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.199409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1090/2171] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:57:59 2022] DELETE /identity/v3/users/befc8b34ea6540d3991b23a58f729736 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:00.201266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3272c-f83f-4309-9c86-6d80904fc17c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.201648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3272c-f83f-4309-9c86-6d80904fc17c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.202012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3272c-f83f-4309-9c86-6d80904fc17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.243455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-40e3272c-f83f-4309-9c86-6d80904fc17c None None] MFA Rules not processed for user `015cc8335a1240a7bd3382eba0a12448`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:00.245005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-40e3272c-f83f-4309-9c86-6d80904fc17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.283298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9afc2-a31e-436a-b501-55ab670cc7e0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.350197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1091/2172] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:00.353291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.353569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.353843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.364495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.365784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.366205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.366612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] PATH_INFO: `/v3/projects/70eb6ccd1b0546969b9d8a08e6aa700f` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.368173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70eb6ccd1b0546969b9d8a08e6aa700f)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.371530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.377371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:00.380228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.389235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1092/2173] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:00.392418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.392642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.406946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632f9af-17a7-4c9c-8f27-cf9e9b4eae0d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.413102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.413836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.414236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.414643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.416261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.418446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.453057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1093/2174] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:00.458095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.460539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70eb6ccd1b0546969b9d8a08e6aa700f', 'request_id': 'req-2935af41-eee4-4bef-9bc8-a7b0e09a2953'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.462000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.475021 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70eb6ccd1b0546969b9d8a08e6aa700f', 'request_id': 'req-2935af41-eee4-4bef-9bc8-a7b0e09a2953'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.487260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70eb6ccd1b0546969b9d8a08e6aa700f', 'request_id': 'req-2935af41-eee4-4bef-9bc8-a7b0e09a2953'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.522656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] The token cache is being invalidate because project 70eb6ccd1b0546969b9d8a08e6aa700f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:00.523583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.524753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.530720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1082/2175] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:00 2022] DELETE /identity/v3/projects/70eb6ccd1b0546969b9d8a08e6aa700f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:00.530720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.530720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.541908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e95ac-3cb1-4849-8702-82e6dfea6a23 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.546872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.547580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.547883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.548128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.550431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.668865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935af41-eee4-4bef-9bc8-a7b0e09a2953 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.706462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.707585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.725403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1094/2176] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:00.726274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.736215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:00.757191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf4e8-4ee0-4a3e-a7ea-d40cf67bbc1d service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.768855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.769773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.770053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.770324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] PATH_INFO: `/v3/users/d419bbc7ce3540498e0cbba53cf20a79` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.773280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d419bbc7ce3540498e0cbba53cf20a79)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.774322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.780194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.781305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.782269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.782674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.784003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.787448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.823965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1083/2177] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:00 2022] POST /identity/v3/users => generated 295 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:00.825387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.846891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b485-5235-4805-a58c-ac738abccb7a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.856033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.857259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.857674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.860173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.861575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.863187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd419bbc7ce3540498e0cbba53cf20a79'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.864611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd419bbc7ce3540498e0cbba53cf20a79'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.866483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.881567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd419bbc7ce3540498e0cbba53cf20a79'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.886476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1084/2178] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:00.887780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.901738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a35aee-0afa-478e-bc6d-66dcfae74051 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:00.906565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd419bbc7ce3540498e0cbba53cf20a79'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.908101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:00.910612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:00.911059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:00.911573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] PATH_INFO: `/v3/projects/a40d261508a84d4c852a41ee34093460/users/8b513b0b7dd14734b35dde7e70dd775a/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:00.922476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd419bbc7ce3540498e0cbba53cf20a79'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:00.930987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40d261508a84d4c852a41ee34093460, user_id=8b513b0b7dd14734b35dde7e70dd775a, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:00.934364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:00.942542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1095/2179] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:00 2022] DELETE /identity/v3/users/d419bbc7ce3540498e0cbba53cf20a79 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:00.953745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1085/2180] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:00 2022] PUT /identity/v3/projects/a40d261508a84d4c852a41ee34093460/users/8b513b0b7dd14734b35dde7e70dd775a/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:00.957734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:00.959220 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:01.053710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fce2e-676f-49c0-8808-8d3cbe0ffa48 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:01.153675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd586a-66ba-4dfd-8796-8de24e633f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:01.154458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd586a-66ba-4dfd-8796-8de24e633f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:01.154660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd586a-66ba-4dfd-8796-8de24e633f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:01.154894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd586a-66ba-4dfd-8796-8de24e633f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:01.155641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd586a-66ba-4dfd-8796-8de24e633f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:01.157826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd586a-66ba-4dfd-8796-8de24e633f51 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:01.173577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1096/2181] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:01.177539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:01.190578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7ec21-3771-45d0-bd45-9292ef085ab7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:01.198050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:01.199641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:01.199641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:01.199967 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] PATH_INFO: `/v3/projects/a40d261508a84d4c852a41ee34093460/users/8b513b0b7dd14734b35dde7e70dd775a/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:01.210912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40d261508a84d4c852a41ee34093460, user_id=8b513b0b7dd14734b35dde7e70dd775a, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:01.214635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:01.225964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1086/2182] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:01 2022] PUT /identity/v3/projects/a40d261508a84d4c852a41ee34093460/users/8b513b0b7dd14734b35dde7e70dd775a/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:01.237508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:01.238004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:01.238286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:01.261771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:01.264673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:01.274612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] MFA Rules not processed for user `8b513b0b7dd14734b35dde7e70dd775a`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:01.276190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:01.379703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1097/2183] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:01.389918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:01.391922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:01.440022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55a971-0f5b-4816-98b6-91565af7bd71 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:01.447671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:01.449040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:01.449536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:01.450001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] PATH_INFO: `/v3/projects/32b005a4be7b40aab2f79fc959cd6549` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:01.451480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b005a4be7b40aab2f79fc959cd6549)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:01.453940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:01.548605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b005a4be7b40aab2f79fc959cd6549', 'request_id': 'req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.548884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538be25-072d-4cfb-8ca9-b9f33205f348 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:01.565683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b005a4be7b40aab2f79fc959cd6549', 'request_id': 'req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.573870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b005a4be7b40aab2f79fc959cd6549', 'request_id': 'req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.595283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] The token cache is being invalidate because project 32b005a4be7b40aab2f79fc959cd6549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:01.595696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.598209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.617117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1087/2184] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:01 2022] DELETE /identity/v3/projects/32b005a4be7b40aab2f79fc959cd6549 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:01.666517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:01.667875 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:01.668078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:01.668354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:01.670843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:01.721375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:01.722831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:01.856207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f42ba-1653-4d14-a8d1-2d114521d9cd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:01.862113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:01.862991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:01.863267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:01.863537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] PATH_INFO: `/v3/projects/271e3142a4a44acd8f99fa19c044f4ce` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:01.864822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271e3142a4a44acd8f99fa19c044f4ce)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:01.866757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:01.868532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:01.870541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:01.882293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1098/2185] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:58:01.929604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271e3142a4a44acd8f99fa19c044f4ce', 'request_id': 'req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.946053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271e3142a4a44acd8f99fa19c044f4ce', 'request_id': 'req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.964009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271e3142a4a44acd8f99fa19c044f4ce', 'request_id': 'req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:01.993823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] The token cache is being invalidate because project 271e3142a4a44acd8f99fa19c044f4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:01.994382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.000630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.006060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1088/2186] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:01 2022] DELETE /identity/v3/projects/271e3142a4a44acd8f99fa19c044f4ce => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:02.010610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:02.033707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4af5-8cee-439c-bebe-f92fe56d4249 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:02.164084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:02.165068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:02.165345 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:02.165613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] PATH_INFO: `/v3/users/e417a2a55dfa4ab3a2555e56b752a5ed` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:02.167175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e417a2a55dfa4ab3a2555e56b752a5ed)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:02.170935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:02.291110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e417a2a55dfa4ab3a2555e56b752a5ed'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.291795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e417a2a55dfa4ab3a2555e56b752a5ed'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.305026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e417a2a55dfa4ab3a2555e56b752a5ed'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.335664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e417a2a55dfa4ab3a2555e56b752a5ed'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.350822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-0ecc03d7-1400-458d-8542-67ba3bb27e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e417a2a55dfa4ab3a2555e56b752a5ed'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.371003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1099/2187] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:02 2022] DELETE /identity/v3/users/e417a2a55dfa4ab3a2555e56b752a5ed => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:02.404754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:02.406352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:02.432413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664d13-cc9f-44c4-9cbf-cc9a6151cf95 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:02.534611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:02.544958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:02.547703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:02.547977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] PATH_INFO: `/v3/users/015cc8335a1240a7bd3382eba0a12448` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:02.551659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] RBAC: Authorizing `identity:delete_user(user_id=015cc8335a1240a7bd3382eba0a12448)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:02.556952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:02.668342 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015cc8335a1240a7bd3382eba0a12448'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.677452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015cc8335a1240a7bd3382eba0a12448'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.678359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015cc8335a1240a7bd3382eba0a12448'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.692756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015cc8335a1240a7bd3382eba0a12448'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.712697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015cc8335a1240a7bd3382eba0a12448'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:02.720542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1089/2188] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:02 2022] DELETE /identity/v3/users/015cc8335a1240a7bd3382eba0a12448 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:02.724900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:02.725274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:02.725613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:02.762012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:02.765434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:02.862500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1100/2189] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:02.918126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:02.924683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:03.021937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f92c-d930-4670-8e5e-dd1b8d48551a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.029281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b6ecb-dffa-4f84-a47d-88b43718248c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.030254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b6ecb-dffa-4f84-a47d-88b43718248c service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.030687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b6ecb-dffa-4f84-a47d-88b43718248c service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.031140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b6ecb-dffa-4f84-a47d-88b43718248c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.042484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b6ecb-dffa-4f84-a47d-88b43718248c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.044615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b6ecb-dffa-4f84-a47d-88b43718248c service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.057869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1090/2190] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:03.073399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.077525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:03.101193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b1736-a52a-4c6d-99e0-0680c95b1b85 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.110430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.111318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.111640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.112419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] PATH_INFO: `/v3/projects/50c6aab7c3924bc5b4036b20fdc5d9b3` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.113525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c6aab7c3924bc5b4036b20fdc5d9b3)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.115419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.178122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c6aab7c3924bc5b4036b20fdc5d9b3', 'request_id': 'req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:03.185006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c6aab7c3924bc5b4036b20fdc5d9b3', 'request_id': 'req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:03.191727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c6aab7c3924bc5b4036b20fdc5d9b3', 'request_id': 'req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:03.217142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] The token cache is being invalidate because project 50c6aab7c3924bc5b4036b20fdc5d9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:03.217678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:03.219330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-77384a0e-8b10-467c-9a7a-a4d2e44d6c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:03.227308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1101/2191] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:03 2022] DELETE /identity/v3/projects/50c6aab7c3924bc5b4036b20fdc5d9b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:03.228541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.229037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.229458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.256651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:03.258161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:03.357662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1091/2192] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:03.365321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.365687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.366018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.392373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:03.393717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:03.408491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1102/2193] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:03.408986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.422527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4ef46-9dff-40c1-868c-32982b538be5 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.429665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.429786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.430220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.430501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.431256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:58:03.431558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.435320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.456524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1092/2194] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:58:03.457783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.494755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86230d31-67e5-4050-ab34-c751493d6c28 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.513503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.514764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.515046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.515319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.516038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.520089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.563224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1103/2195] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:03 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:03.565125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.577390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660003f9-8918-4598-89da-97e9c8ae46e9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.700602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.701628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.702050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.702502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.703374 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.705558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.738015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1093/2196] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:03 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:03.741123 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.751905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1716818-9784-4d45-ac56-3e8aba0c933a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.757011 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.757764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.758006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.758279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.759285 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.761270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.775692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1104/2197] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:03.781162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.796005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a583d-08bb-4b65-8d61-47fbcee7b765 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.801384 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.802053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.802502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.802788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.803581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.805286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.821213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1094/2198] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:03.822563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.833761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08e11-2c6b-46b6-a639-483c29563c06 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.838622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9d99c-fbc7-4a98-9a8b-a19df1076586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.839512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9d99c-fbc7-4a98-9a8b-a19df1076586 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.842761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9d99c-fbc7-4a98-9a8b-a19df1076586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.843050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9d99c-fbc7-4a98-9a8b-a19df1076586 admin admin] PATH_INFO: `/v3/projects/765f7d3208da4372bc62e85c715ef29e/users/d521859c680b4a5a881a3a11d7686ac5/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.844139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:03.846406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:03.865664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99219-9964-4c73-a3a6-df6acb194051 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:03.869475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9d99c-fbc7-4a98-9a8b-a19df1076586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765f7d3208da4372bc62e85c715ef29e, user_id=d521859c680b4a5a881a3a11d7686ac5, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.872637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9d99c-fbc7-4a98-9a8b-a19df1076586 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.873441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:03.874557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.876545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.877527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] PATH_INFO: `/v3/projects/8f9e0612acf343dc9aa211d09365aad7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.879196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9e0612acf343dc9aa211d09365aad7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:03.881474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:03.908849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1105/2199] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:03 2022] PUT /identity/v3/projects/765f7d3208da4372bc62e85c715ef29e/users/d521859c680b4a5a881a3a11d7686ac5/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:03.910760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430887-a820-406f-aa18-d9df7774575d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:03.911024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430887-a820-406f-aa18-d9df7774575d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:03.911297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430887-a820-406f-aa18-d9df7774575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:03.965544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-40430887-a820-406f-aa18-d9df7774575d None None] MFA Rules not processed for user `d521859c680b4a5a881a3a11d7686ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:03.966821 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-40430887-a820-406f-aa18-d9df7774575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:03.990925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9e0612acf343dc9aa211d09365aad7', 'request_id': 'req-2b817db8-73e0-4091-b44f-264629568933'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.004352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9e0612acf343dc9aa211d09365aad7', 'request_id': 'req-2b817db8-73e0-4091-b44f-264629568933'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.016499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9e0612acf343dc9aa211d09365aad7', 'request_id': 'req-2b817db8-73e0-4091-b44f-264629568933'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.030451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] The token cache is being invalidate because project 8f9e0612acf343dc9aa211d09365aad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:04.030907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.031772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.038255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1095/2200] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:03 2022] DELETE /identity/v3/projects/8f9e0612acf343dc9aa211d09365aad7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:04.045673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.047893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:04.078420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1106/2201] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:04.087755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40430887-a820-406f-aa18-d9df7774575d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.089406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-40430887-a820-406f-aa18-d9df7774575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:04.207046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b817db8-73e0-4091-b44f-264629568933 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:04.222284 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:04.223248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:04.223517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:04.223801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] PATH_INFO: `/v3/users/8b513b0b7dd14734b35dde7e70dd775a` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:04.229934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b513b0b7dd14734b35dde7e70dd775a)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:04.235221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:04.247471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40430887-a820-406f-aa18-d9df7774575d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:04.264975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:04.265838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:04.266086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:04.266367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:04.267092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:04.269788 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:04.336856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1107/2202] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:04 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:04.343042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.347647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b513b0b7dd14734b35dde7e70dd775a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.368798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b513b0b7dd14734b35dde7e70dd775a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.369615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b513b0b7dd14734b35dde7e70dd775a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.385214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b513b0b7dd14734b35dde7e70dd775a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.427756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b513b0b7dd14734b35dde7e70dd775a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:04.448790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1096/2203] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:04 2022] DELETE /identity/v3/users/8b513b0b7dd14734b35dde7e70dd775a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:04.526873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa139d-5c79-47d6-b721-27fce1d587dc admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:04.646004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:04.647107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:04.648065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:04.648693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:04.649975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:04.652605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:04.683704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1108/2204] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:04 2022] POST /identity/v3/users => generated 300 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:04.687915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.689979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:04.705224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a406c-81d2-4870-a119-90f04e6662c3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:04.710493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:04.711746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:04.712034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:04.712311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:04.713718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:04.715372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:04.733915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1097/2205] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:58:04.738191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.755811 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a433a-58c2-4b6f-bcc7-2e8587cab2d3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:04.776264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:04.778089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:04.784411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:04.784693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] PATH_INFO: `/v3/projects/bb39742c9b6944a28e86bd294773cafe/users/d1eb77ee64db4ee2b4b0fe50be0aefbf/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:04.819558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb39742c9b6944a28e86bd294773cafe, user_id=d1eb77ee64db4ee2b4b0fe50be0aefbf, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:04.822806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:04.843837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1109/2206] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:04 2022] PUT /identity/v3/projects/bb39742c9b6944a28e86bd294773cafe/users/d1eb77ee64db4ee2b4b0fe50be0aefbf/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:04.848077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.865350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197a7d4-2d4d-46c1-ba39-af7545258cfb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:04.961150 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:04.961850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:04.962131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:04.962404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:04.963355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:04.965418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:04.977638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.979675 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1098/2207] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:04.981114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:04.983687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:04.995540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb240-f3c2-4461-9618-b3abd7e4adc9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.001659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a145-933b-4c05-9035-7eb777b53455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.002618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a145-933b-4c05-9035-7eb777b53455 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.002893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a145-933b-4c05-9035-7eb777b53455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.003162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a145-933b-4c05-9035-7eb777b53455 admin admin] PATH_INFO: `/v3/projects/bb39742c9b6944a28e86bd294773cafe/users/d1eb77ee64db4ee2b4b0fe50be0aefbf/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.005242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a145-933b-4c05-9035-7eb777b53455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb39742c9b6944a28e86bd294773cafe, user_id=d1eb77ee64db4ee2b4b0fe50be0aefbf, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.008784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a145-933b-4c05-9035-7eb777b53455 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:05.023868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c362-182c-4de4-93bf-f057ab556d40 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.031381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1099/2208] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:04 2022] PUT /identity/v3/projects/bb39742c9b6944a28e86bd294773cafe/users/d1eb77ee64db4ee2b4b0fe50be0aefbf/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:05.033007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04bef-061f-4b60-a549-76583078699b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.033305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04bef-061f-4b60-a549-76583078699b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.033718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04bef-061f-4b60-a549-76583078699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.069495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-40a04bef-061f-4b60-a549-76583078699b None None] MFA Rules not processed for user `d1eb77ee64db4ee2b4b0fe50be0aefbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:05.070763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-40a04bef-061f-4b60-a549-76583078699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.161011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1100/2209] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:05.171663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04bef-061f-4b60-a549-76583078699b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:05.173889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-40a04bef-061f-4b60-a549-76583078699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.191889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.194492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.195386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.195985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] PATH_INFO: `/v3/projects/a40d261508a84d4c852a41ee34093460` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.197479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40d261508a84d4c852a41ee34093460)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.199985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:05.273040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04bef-061f-4b60-a549-76583078699b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.288921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40d261508a84d4c852a41ee34093460', 'request_id': 'req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.297938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40d261508a84d4c852a41ee34093460', 'request_id': 'req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.309787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40d261508a84d4c852a41ee34093460', 'request_id': 'req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.337531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] The token cache is being invalidate because project a40d261508a84d4c852a41ee34093460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:05.337825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.338538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-df6c2089-a8d7-4c9a-80be-fe8b5027a51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.341496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1110/2210] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:04 2022] DELETE /identity/v3/projects/a40d261508a84d4c852a41ee34093460 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:05.349369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.349763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.350178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.357019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.357781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.358121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.358747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.361607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.381785 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:05.383038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.455712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.457719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532e836-3f92-4278-a2e3-36b5d6ae9856 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:05.474566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1101/2211] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:58:05.479032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1111/2212] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:05.486846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.487169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.487496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.542508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:05.543834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.568266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1102/2213] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:05.572535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:05.586826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991dcbc-d9a3-408b-9b53-c4d0ee161fb3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.602527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.603574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.604573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.604904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.605710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:58:05.606192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.608414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:05.623189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:05.624791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.629275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1112/2214] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:58:05.635851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:05.637529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e61f-ea37-4226-811f-e19a9d7487a7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.642970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.643993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.644371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.644765 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] PATH_INFO: `/v3/users/d521859c680b4a5a881a3a11d7686ac5` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.646758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d521859c680b4a5a881a3a11d7686ac5)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.649238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:05.662902 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaee6d0-a696-4b71-8eac-689b3eb81f89 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.678622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.679525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.679722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.679997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.682555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.682934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:05.725479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd521859c680b4a5a881a3a11d7686ac5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.737915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1113/2215] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:05.740462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:05.744407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd521859c680b4a5a881a3a11d7686ac5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.745146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd521859c680b4a5a881a3a11d7686ac5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.760385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd521859c680b4a5a881a3a11d7686ac5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.788011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b252218e-1e72-4b71-866c-a4950867e730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd521859c680b4a5a881a3a11d7686ac5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:05.801797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1103/2216] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:05 2022] DELETE /identity/v3/users/d521859c680b4a5a881a3a11d7686ac5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:05.806784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.807163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.807533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.854665 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:05.855895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:05.879178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12f72d-c62f-40ce-99b8-fdbce62e66e7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:05.992966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1104/2217] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:05.993102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:05.993621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:05.993902 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:05.994202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:05.995072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:05.997555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.003886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.008077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:06.048787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1114/2218] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:05 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:06.051315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.053553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:06.075157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d568ea3-0e6d-4425-8149-9f306b21a0df admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.084760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.085577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.085894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.088911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.088911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.096997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.098983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124b0c6-d7b7-40b8-b4e5-abd6a60fd2bc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.103207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.103939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.104146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.104423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.119795 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1115/2219] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:06.122956 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.125963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.127525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.141051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cadbe-fccb-4bed-9be0-71986aeb3c3a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.146136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1105/2220] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:58:06.146671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15843883-cb64-4990-8f16-f26acb6ad6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.147494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843883-cb64-4990-8f16-f26acb6ad6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.147777 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843883-cb64-4990-8f16-f26acb6ad6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.148050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843883-cb64-4990-8f16-f26acb6ad6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.148853 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15843883-cb64-4990-8f16-f26acb6ad6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.150533 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15843883-cb64-4990-8f16-f26acb6ad6fa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.176778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1116/2221] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:06.179154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.190277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae85e89-d9fc-4571-8201-dd5e69530db6 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.197076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.198706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.199331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.200078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] PATH_INFO: `/v3/projects/876e2659b11d4eff97272d00a0014db8/users/36ef36890560444abb61167384fb7798/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.238231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876e2659b11d4eff97272d00a0014db8, user_id=36ef36890560444abb61167384fb7798, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.242574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.274402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1106/2222] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:06 2022] PUT /identity/v3/projects/876e2659b11d4eff97272d00a0014db8/users/36ef36890560444abb61167384fb7798/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:06.286122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.286683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.286920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.341895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] MFA Rules not processed for user `36ef36890560444abb61167384fb7798`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:06.343488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:06.456787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1117/2223] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:06.465358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.467137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:06.572985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64237236-efe1-4913-8f80-40583c918ab4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.577949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.578871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.579421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.579900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.592894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.594468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.607699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.609609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:06.624235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1107/2224] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:06.715641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2413b2-e5cc-4fda-b0e7-c310f584a0b9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.722523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.724210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.725050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.725153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] PATH_INFO: `/v3/projects/765f7d3208da4372bc62e85c715ef29e` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.726626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765f7d3208da4372bc62e85c715ef29e)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.729120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:06.814894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765f7d3208da4372bc62e85c715ef29e', 'request_id': 'req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:06.826212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765f7d3208da4372bc62e85c715ef29e', 'request_id': 'req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:06.834997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765f7d3208da4372bc62e85c715ef29e', 'request_id': 'req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:06.855999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] The token cache is being invalidate because project 765f7d3208da4372bc62e85c715ef29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:06.856282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:06.856968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5bfd1f6c-b3a3-4f2a-bb96-6f39e8620b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:06.861655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1118/2225] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:06 2022] DELETE /identity/v3/projects/765f7d3208da4372bc62e85c715ef29e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:06.862973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:06.875247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305df528-189a-4386-8fcf-fe3ceaa0a56e service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:06.989436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:06.990226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:06.990505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:06.992930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] PATH_INFO: `/v3/users/d1eb77ee64db4ee2b4b0fe50be0aefbf` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:06.998549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1eb77ee64db4ee2b4b0fe50be0aefbf)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:06.999528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:07.088999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1eb77ee64db4ee2b4b0fe50be0aefbf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.104949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1eb77ee64db4ee2b4b0fe50be0aefbf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.105933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1eb77ee64db4ee2b4b0fe50be0aefbf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.114960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1eb77ee64db4ee2b4b0fe50be0aefbf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.140041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1eb77ee64db4ee2b4b0fe50be0aefbf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.146841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1108/2226] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:06 2022] DELETE /identity/v3/users/d1eb77ee64db4ee2b4b0fe50be0aefbf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:07.179520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.179808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.180080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.208836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] MFA Rules not processed for user `aa4fbbf421f34df6b34b27f3ee5247b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:07.210179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:07.275300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1119/2227] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:07.287456 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:07.289022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:07.368024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1815-494a-408c-8450-a95685665577 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:07.374501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41014f3-5f6a-4610-a8b8-eb3bbddef5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:07.375152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41014f3-5f6a-4610-a8b8-eb3bbddef5a8 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.375427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41014f3-5f6a-4610-a8b8-eb3bbddef5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.375691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41014f3-5f6a-4610-a8b8-eb3bbddef5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.384205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41014f3-5f6a-4610-a8b8-eb3bbddef5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:07.385867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41014f3-5f6a-4610-a8b8-eb3bbddef5a8 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:07.394928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1109/2228] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:07.428479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:07.430520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:07.609453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f7403-b2ae-4319-88d4-ae60cb7bcada None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:07.615515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:07.616649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.620705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.621504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] PATH_INFO: `/v3/projects/bb39742c9b6944a28e86bd294773cafe` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.624516 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb39742c9b6944a28e86bd294773cafe)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:07.628065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:07.681910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb39742c9b6944a28e86bd294773cafe', 'request_id': 'req-f6daacfd-9317-4e52-9b43-22fd750d004e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.688633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb39742c9b6944a28e86bd294773cafe', 'request_id': 'req-f6daacfd-9317-4e52-9b43-22fd750d004e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.694688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb39742c9b6944a28e86bd294773cafe', 'request_id': 'req-f6daacfd-9317-4e52-9b43-22fd750d004e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.715272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] The token cache is being invalidate because project bb39742c9b6944a28e86bd294773cafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:07.715562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.716219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f6daacfd-9317-4e52-9b43-22fd750d004e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:07.728197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1120/2229] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:07 2022] DELETE /identity/v3/projects/bb39742c9b6944a28e86bd294773cafe => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:07.734381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.735283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.735789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.756812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:07.758345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:07.862449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1110/2230] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:07.870380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.870674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.870950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.911044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:07.912300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:07.929447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1121/2231] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:07.934041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:07.944987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c66e4-e5af-4bb7-8a1a-e84e9d23d7ae None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:07.950517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:07.951310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.951692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.952035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.952913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:58:07.953287 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:07.955495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:07.976252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1111/2232] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:58:07.978394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:07.990052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a88f-f266-458b-ab69-3ced0d2ef6ac None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:07.995317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:07.996403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:07.996687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:07.997012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:07.998471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:08.001843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:08.040029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1122/2233] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:07 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:58:08.044357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:08.073226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335355-5842-4926-8885-4a0bf7a4c2d0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:08.170626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:08.171316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:08.171658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:08.171937 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:08.172866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:08.174885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:08.205601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1112/2234] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:08 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:08.209184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:08.226881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02d185-f262-42d9-b5e5-ababc15b3f26 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:08.236878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:08.237688 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:08.237871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:08.238103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:08.238859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:08.240521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:08.254967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1123/2235] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:08.259839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:08.274405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3215d-d455-421c-982e-671d243d2c01 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:08.282635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53f657-3b1d-4658-bb9c-b25035be6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:08.283577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53f657-3b1d-4658-bb9c-b25035be6aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:08.283781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53f657-3b1d-4658-bb9c-b25035be6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:08.284082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53f657-3b1d-4658-bb9c-b25035be6aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:08.285556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53f657-3b1d-4658-bb9c-b25035be6aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:08.287294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53f657-3b1d-4658-bb9c-b25035be6aa5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:08.304762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1113/2236] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:08.307514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:08.321678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268557-9263-4f5c-b3c6-bd88aa2cfab2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:08.328672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:08.342767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:08.344361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:08.346362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] PATH_INFO: `/v3/projects/4cde077871f94db3a608b5b79c01883e/users/2eb1f6ef4005482f8dba7efb00068639/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:08.389934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cde077871f94db3a608b5b79c01883e, user_id=2eb1f6ef4005482f8dba7efb00068639, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:08.395290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:08.417459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1124/2237] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:08 2022] PUT /identity/v3/projects/4cde077871f94db3a608b5b79c01883e/users/2eb1f6ef4005482f8dba7efb00068639/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:08.421792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806497b-0d35-4be4-bb07-53bdf56a7730 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:08.422430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806497b-0d35-4be4-bb07-53bdf56a7730 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:08.422766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806497b-0d35-4be4-bb07-53bdf56a7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:08.442705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f806497b-0d35-4be4-bb07-53bdf56a7730 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:08.444338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f806497b-0d35-4be4-bb07-53bdf56a7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:08.530467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1114/2238] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:08.548122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:08.551436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:08.626107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be2d8-a126-4697-9f84-8367f0712d66 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:08.630130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:08.630799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:08.631653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:08.632116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:08.645202 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:08.646716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:08.659454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1125/2239] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:58:10.147271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7dd1b-f768-4547-a64f-7bada66618d9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:10.148272 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7dd1b-f768-4547-a64f-7bada66618d9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:10.148779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7dd1b-f768-4547-a64f-7bada66618d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:10.171965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-17b7dd1b-f768-4547-a64f-7bada66618d9 None None] MFA Rules not processed for user `aa4fbbf421f34df6b34b27f3ee5247b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:10.173749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-17b7dd1b-f768-4547-a64f-7bada66618d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:10.258206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1115/2240] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:15.077426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:15.079243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:15.094703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75d3c6-8e68-4899-a72d-8effaf03533b service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:15.101286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:15.102924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:15.103531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:15.103897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] PATH_INFO: `/v3/users/36ef36890560444abb61167384fb7798` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:15.105515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ef36890560444abb61167384fb7798)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:15.107703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:15.165511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ef36890560444abb61167384fb7798'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:15.167355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ef36890560444abb61167384fb7798'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:15.175396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ef36890560444abb61167384fb7798'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:15.188018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ef36890560444abb61167384fb7798'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:15.198706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ef36890560444abb61167384fb7798'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:15.208804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1126/2241] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:15 2022] DELETE /identity/v3/users/36ef36890560444abb61167384fb7798 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:15.214405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:15.214876 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:15.215011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:15.236042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:15.237526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:15.332962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1116/2242] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:15.349644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:15.351159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:15.443004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280601-76a5-4ad3-b844-d09be4d6a355 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:15.447031 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04720e9c-a824-4df6-9580-1e5063d5378f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:15.447606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04720e9c-a824-4df6-9580-1e5063d5378f service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:15.447888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04720e9c-a824-4df6-9580-1e5063d5378f service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:15.448158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04720e9c-a824-4df6-9580-1e5063d5378f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:15.458824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04720e9c-a824-4df6-9580-1e5063d5378f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:15.460504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04720e9c-a824-4df6-9580-1e5063d5378f service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:15.476374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1127/2243] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:15.937339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:15.938747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:15.965263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4be427-84bd-4dbe-95b8-fe6c33203f34 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:15.972185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:15.973309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:15.973728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:15.974207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] PATH_INFO: `/v3/projects/876e2659b11d4eff97272d00a0014db8` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:15.975717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876e2659b11d4eff97272d00a0014db8)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:15.978313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.049585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876e2659b11d4eff97272d00a0014db8', 'request_id': 'req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:16.062375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876e2659b11d4eff97272d00a0014db8', 'request_id': 'req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:16.078153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876e2659b11d4eff97272d00a0014db8', 'request_id': 'req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:16.097207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] The token cache is being invalidate because project 876e2659b11d4eff97272d00a0014db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:16.097623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:16.098357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-56e0f62d-38a1-48ac-9634-59c61b5c9ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:16.105575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1117/2244] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:15 2022] DELETE /identity/v3/projects/876e2659b11d4eff97272d00a0014db8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:16.106722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8765ab5-75f8-4b95-a9bf-057f87916556 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.107162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8765ab5-75f8-4b95-a9bf-057f87916556 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.107251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8765ab5-75f8-4b95-a9bf-057f87916556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.127585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c8765ab5-75f8-4b95-a9bf-057f87916556 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:16.129734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c8765ab5-75f8-4b95-a9bf-057f87916556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:16.213307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1128/2245] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:16.221380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.221854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.222264 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.244237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:16.246244 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:16.261653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1118/2246] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:16.271940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.272461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.272939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.273417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.287699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999493ed-d9f4-48c3-8faa-988b20c3ff5a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.293129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.293817 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.294350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.294627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.295563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:58:16.296204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.298718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.322062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] MFA Rules not processed for user `2eb1f6ef4005482f8dba7efb00068639`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:16.323878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:16.327079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1119/2247] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:58:16.331951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.355243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319674-2e94-4b8f-8627-364a54feda05 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.381566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.382731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.383196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.383833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.384743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.386898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.464423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1120/2248] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:16.465380 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.484972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1129/2249] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:16.486223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.490731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:16.522664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb05b40-8f9b-43d9-8d4d-be0fa107f44c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.588236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dbbf4-dc93-408c-b3fd-52b8512298d1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.597772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.598998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.599615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.600045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.601294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.604497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.627996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.629313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.629831 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.630318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.631268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.634260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.667338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1121/2250] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:16.668293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.683860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1130/2251] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:16.687838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.697774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235c8e0-d8cf-4143-8982-31b00150975b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.785004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.786804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.787078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.787754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.789505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.793707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.797379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b7b1-1c74-4be5-9b57-8ef83398082a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.808335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1122/2252] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:16.809418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.810249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.810626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.811035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.811971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.813203 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.815298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.828040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab5d5-1d42-4503-91f5-fe04194ba8e0 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.837801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.839072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.839524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.840054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.841097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.843026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.860185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1123/2253] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:16.865539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1131/2254] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:58:16.866922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.869262 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.896708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ef2f2-e85b-4a07-94fb-3664419ef650 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.900536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e066bb-5af7-450f-b890-99ebae744dbe admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.902970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.904210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.904640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.905132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.906356 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.909397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689c1ee-5d8f-415d-a10e-3f3868b88197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.910567 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689c1ee-5d8f-415d-a10e-3f3868b88197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.911282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689c1ee-5d8f-415d-a10e-3f3868b88197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.911528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.911929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689c1ee-5d8f-415d-a10e-3f3868b88197 admin admin] PATH_INFO: `/v3/projects/0cef30d8659545dea49f0e31620ef1b2/users/7dc17a0b569244b3831a026b78392dfd/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.925625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1132/2255] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:16.932055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:16.936695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689c1ee-5d8f-415d-a10e-3f3868b88197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cef30d8659545dea49f0e31620ef1b2, user_id=7dc17a0b569244b3831a026b78392dfd, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.940302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689c1ee-5d8f-415d-a10e-3f3868b88197 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:16.943764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b81e5a-b884-4ea5-8ba4-bc43e9c1c34f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:16.950829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:16.952899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.953183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.953466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] PATH_INFO: `/v3/projects/81cffb18ef6f4455ac919fcbf571016a/users/144cbd561c0f4246a71ce020865d1712/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.969195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1124/2256] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:16 2022] PUT /identity/v3/projects/0cef30d8659545dea49f0e31620ef1b2/users/7dc17a0b569244b3831a026b78392dfd/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:16.980926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:16.981305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:16.981740 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:16.989925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cffb18ef6f4455ac919fcbf571016a, user_id=144cbd561c0f4246a71ce020865d1712, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:16.993372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:17.019519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1133/2257] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:16 2022] PUT /identity/v3/projects/81cffb18ef6f4455ac919fcbf571016a/users/144cbd561c0f4246a71ce020865d1712/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:17.023793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:17.073231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] MFA Rules not processed for user `7dc17a0b569244b3831a026b78392dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:17.076498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:17.128640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e970aab-b100-4952-822c-07c4199d10b8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:17.142904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:17.143589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:17.143867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:17.144200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:17.145189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:17.147866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:17.169685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1134/2258] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:17.174988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:17.210138 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3fe4-789f-41cf-b460-59bf6fe364c1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:17.222909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:17.225274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:17.226050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1125/2259] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:17.226892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:17.229260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] PATH_INFO: `/v3/projects/81cffb18ef6f4455ac919fcbf571016a/users/144cbd561c0f4246a71ce020865d1712/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:17.236521 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cffb18ef6f4455ac919fcbf571016a, user_id=144cbd561c0f4246a71ce020865d1712, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:17.237983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:17.241685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:17.253086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:17.278563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1135/2260] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:17 2022] PUT /identity/v3/projects/81cffb18ef6f4455ac919fcbf571016a/users/144cbd561c0f4246a71ce020865d1712/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:17.326658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d5e5-4cdb-411b-b6f4-d9d2e2c47da3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:17.397030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bea9a-a053-403e-a245-3dfe2986bd5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:17.397894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bea9a-a053-403e-a245-3dfe2986bd5e service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:17.398745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bea9a-a053-403e-a245-3dfe2986bd5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:17.399031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bea9a-a053-403e-a245-3dfe2986bd5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:17.521031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bea9a-a053-403e-a245-3dfe2986bd5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:17.522636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bea9a-a053-403e-a245-3dfe2986bd5e service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:17.532820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1126/2261] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:58:21.365424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:21.440757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d5f0e-aeb3-4741-bcd3-42766f76fe76 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:21.452223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:21.454476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:21.454476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:21.454476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] PATH_INFO: `/v3/users/7dc17a0b569244b3831a026b78392dfd` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:21.456467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc17a0b569244b3831a026b78392dfd)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:21.458419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:21.605009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc17a0b569244b3831a026b78392dfd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:21.606111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc17a0b569244b3831a026b78392dfd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:21.628253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc17a0b569244b3831a026b78392dfd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:21.657065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc17a0b569244b3831a026b78392dfd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:21.680161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc17a0b569244b3831a026b78392dfd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:21.694039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:21.694550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:21.694712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:21.696694 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1136/2262] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:21 2022] DELETE /identity/v3/users/7dc17a0b569244b3831a026b78392dfd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:21.715705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:21.717290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:21.791479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1127/2263] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:21.798576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:21.802083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:21.951734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f406e5-b4fc-40ec-9761-40f21d4376d2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:21.961575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2684b8-e39a-4de8-89cc-bcfa233d7710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:21.962405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2684b8-e39a-4de8-89cc-bcfa233d7710 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:21.962833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2684b8-e39a-4de8-89cc-bcfa233d7710 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:21.963242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2684b8-e39a-4de8-89cc-bcfa233d7710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:21.976192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2684b8-e39a-4de8-89cc-bcfa233d7710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:21.978350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2684b8-e39a-4de8-89cc-bcfa233d7710 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:21.994520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1137/2264] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:22.795824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:22.798123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:22.821438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442e1f6-8927-4f4a-9700-3229594b36f0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:22.828412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:22.842383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:22.842900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:22.843347 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] PATH_INFO: `/v3/projects/0cef30d8659545dea49f0e31620ef1b2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:22.845334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cef30d8659545dea49f0e31620ef1b2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:22.847537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:22.919606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cef30d8659545dea49f0e31620ef1b2', 'request_id': 'req-fe70739e-1539-484f-ae23-6471373a0bb8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:22.931334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cef30d8659545dea49f0e31620ef1b2', 'request_id': 'req-fe70739e-1539-484f-ae23-6471373a0bb8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:22.944019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cef30d8659545dea49f0e31620ef1b2', 'request_id': 'req-fe70739e-1539-484f-ae23-6471373a0bb8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:22.956932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] The token cache is being invalidate because project 0cef30d8659545dea49f0e31620ef1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:22.957820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:22.958888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fe70739e-1539-484f-ae23-6471373a0bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:22.961187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1128/2265] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:22 2022] DELETE /identity/v3/projects/0cef30d8659545dea49f0e31620ef1b2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:22.967491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:22.968360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:22.968928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.005763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:23.007180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:23.077949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1138/2266] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:23.086616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.087311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.087311 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.113372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:23.114750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:23.123406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1129/2267] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:23.127644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.138006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb00156-b73f-4f70-852d-a0bb42d41f47 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.143056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.143746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.144023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.144290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.145054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:58:23.145353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.146971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.159461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1139/2268] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:58:23.163591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.173237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01a32-1380-4952-bd37-a183ca1c6bb6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.178185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.178962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.181126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.181368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.182207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.184223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.216023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1130/2269] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:23 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:23.216914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.229433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423195-0d33-4c09-87bb-0c53b2d25f77 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.330335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.333681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.334194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.334653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.335732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.338224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.367136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1140/2270] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:23 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:58:23.371267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.392959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58129b3b-2386-4139-9fd0-a74591ae12d1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.400761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.401791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.402301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.402871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.404576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.406637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.427934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1131/2271] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:23.431568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.443095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56586a-6022-4ce1-b619-850a3d6a60a6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.448922 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd58cb-2a01-4c11-bb4c-e6b0760970b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.450018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd58cb-2a01-4c11-bb4c-e6b0760970b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.450410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd58cb-2a01-4c11-bb4c-e6b0760970b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.450958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd58cb-2a01-4c11-bb4c-e6b0760970b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.451783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd58cb-2a01-4c11-bb4c-e6b0760970b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.453674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd58cb-2a01-4c11-bb4c-e6b0760970b1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.478835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.479497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1141/2272] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:23.492375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd8393-20f6-4ba4-bac8-432df639e847 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.498031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2530-4525-4a2f-b19a-e253f68bdc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.498947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2530-4525-4a2f-b19a-e253f68bdc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.499221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2530-4525-4a2f-b19a-e253f68bdc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.499959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2530-4525-4a2f-b19a-e253f68bdc06 admin admin] PATH_INFO: `/v3/projects/c9944dfde9004cd8a8b27b972668abb8/users/e6cd8bf89ccc41d08e1507d632277b4b/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.545828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2530-4525-4a2f-b19a-e253f68bdc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9944dfde9004cd8a8b27b972668abb8, user_id=e6cd8bf89ccc41d08e1507d632277b4b, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.548785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2530-4525-4a2f-b19a-e253f68bdc06 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.611962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1132/2273] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:23 2022] PUT /identity/v3/projects/c9944dfde9004cd8a8b27b972668abb8/users/e6cd8bf89ccc41d08e1507d632277b4b/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:23.616350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.616859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.617342 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.661508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.661890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.662260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.694791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] MFA Rules not processed for user `e6cd8bf89ccc41d08e1507d632277b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:23.696820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:23.713607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] MFA Rules not processed for user `144cbd561c0f4246a71ce020865d1712`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:23.716190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:23.805944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1142/2274] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:23.814444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.815915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:23.840303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1133/2275] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:23.905465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab509d-746b-497d-bcad-3540a294ebed None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:23.909299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92c329-fce9-4f3e-a1e2-2074cb3d02d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:23.910111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92c329-fce9-4f3e-a1e2-2074cb3d02d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:23.910448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92c329-fce9-4f3e-a1e2-2074cb3d02d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:23.910722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92c329-fce9-4f3e-a1e2-2074cb3d02d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:23.920265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92c329-fce9-4f3e-a1e2-2074cb3d02d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:23.921771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92c329-fce9-4f3e-a1e2-2074cb3d02d9 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:23.943910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1143/2276] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:23.993789 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:23.995558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:24.173365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5617-9c0d-4f6b-be35-4071e0017fa2 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:24.182889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:24.184116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:24.184399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:24.184846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:24.187457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:24.298283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:24.308248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:24.320190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1134/2277] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:24.799185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1529ee-8153-4e74-9e76-d9194032b479 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:24.799738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1529ee-8153-4e74-9e76-d9194032b479 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:24.800041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1529ee-8153-4e74-9e76-d9194032b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:24.819720 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4a1529ee-8153-4e74-9e76-d9194032b479 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:24.821309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4a1529ee-8153-4e74-9e76-d9194032b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:24.884652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1144/2278] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 02:58:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:24.897888 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:24.899892 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:24.971434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dea06-32c6-4145-9d7b-aba2b2fb459d service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:24.976985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a38a7-a051-4e6f-8add-9598511f93ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:24.978174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a38a7-a051-4e6f-8add-9598511f93ab service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:24.978268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a38a7-a051-4e6f-8add-9598511f93ab service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:24.978544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a38a7-a051-4e6f-8add-9598511f93ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:24.988540 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a38a7-a051-4e6f-8add-9598511f93ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:24.990514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a38a7-a051-4e6f-8add-9598511f93ab service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:25.003676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1135/2279] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 02:58:26.724209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:26.725304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:26.725703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:26.761421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] MFA Rules not processed for user `2eb1f6ef4005482f8dba7efb00068639`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:26.765307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:26.782247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1145/2280] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:28.522117 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765941c-3e95-442a-bd0d-80dc868e4318 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:28.522990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765941c-3e95-442a-bd0d-80dc868e4318 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:28.523634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765941c-3e95-442a-bd0d-80dc868e4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:28.564551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9765941c-3e95-442a-bd0d-80dc868e4318 None None] MFA Rules not processed for user `087b5f4f3891413b8b7fa727768c09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:28.566381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9765941c-3e95-442a-bd0d-80dc868e4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:28.656673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1136/2281] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:35.541524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:35.631979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70ead-5b96-4245-8240-09204088f548 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:35.638594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:35.639779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:35.640351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:35.640626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] PATH_INFO: `/v3/users/e6cd8bf89ccc41d08e1507d632277b4b` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:35.642425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6cd8bf89ccc41d08e1507d632277b4b)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:35.645274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:35.714389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6cd8bf89ccc41d08e1507d632277b4b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:35.714978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6cd8bf89ccc41d08e1507d632277b4b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:35.723607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6cd8bf89ccc41d08e1507d632277b4b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:35.739341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6cd8bf89ccc41d08e1507d632277b4b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:35.749346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6cd8bf89ccc41d08e1507d632277b4b'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:35.756149 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1146/2282] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:35 2022] DELETE /identity/v3/users/e6cd8bf89ccc41d08e1507d632277b4b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:35.760853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:35.761399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:35.761399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:35.779816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:35.781309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:35.843572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1137/2283] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:58:35.854913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:35.856430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:35.924152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d4a2c-deae-4547-a229-3f4e6c3f586b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:35.930053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a67f3a-0374-4c17-ae13-51f6388370ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:35.931033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67f3a-0374-4c17-ae13-51f6388370ec service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:35.931420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67f3a-0374-4c17-ae13-51f6388370ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:35.931770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a67f3a-0374-4c17-ae13-51f6388370ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:35.942970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a67f3a-0374-4c17-ae13-51f6388370ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:35.944885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a67f3a-0374-4c17-ae13-51f6388370ec service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:35.956322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1147/2284] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:58:36.319563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:36.321402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:36.344248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e72d9-3b10-48e3-bd75-218c91fc3ba0 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:36.352529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:36.353834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:36.354326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:36.354600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] PATH_INFO: `/v3/projects/c9944dfde9004cd8a8b27b972668abb8` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:36.355933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9944dfde9004cd8a8b27b972668abb8)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:36.358126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:36.416786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9944dfde9004cd8a8b27b972668abb8', 'request_id': 'req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:36.426174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9944dfde9004cd8a8b27b972668abb8', 'request_id': 'req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:36.450523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9944dfde9004cd8a8b27b972668abb8', 'request_id': 'req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:36.462982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] The token cache is being invalidate because project c9944dfde9004cd8a8b27b972668abb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:36.463294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:36.464178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:36.488864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1138/2285] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:36 2022] DELETE /identity/v3/projects/c9944dfde9004cd8a8b27b972668abb8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:54.015941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:54.016458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:54.016458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:54.035544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:54.036743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:54.096145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1148/2286] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 3 02:58:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:54.109928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:54.111409 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:54.177666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb9274-cf69-4b4d-bf2f-3c4872c1b29b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:54.182775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:54.183427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:54.183709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:54.183981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:54.192408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:54.194066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:54.202214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1139/2287] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 02:58:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 02:58:56.382012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:56.384114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:56.476189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a71a67-15d7-4a98-a8a1-73a4f349357b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:56.482227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:56.483173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:56.483569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:56.483901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] PATH_INFO: `/v3/users/3754bf46af13470faf170277d5086e88` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:56.485236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3754bf46af13470faf170277d5086e88)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:56.487224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:56.536327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3754bf46af13470faf170277d5086e88'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.536935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3754bf46af13470faf170277d5086e88'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.543659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3754bf46af13470faf170277d5086e88'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.556574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3754bf46af13470faf170277d5086e88'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.566250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6e212b5e-ce7a-4610-abec-4f00c99754e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3754bf46af13470faf170277d5086e88'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.575318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1149/2288] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:58:56 2022] DELETE /identity/v3/users/3754bf46af13470faf170277d5086e88 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:58:56.749142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:56.761038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41ce9d-3f48-4aa6-aedc-bc8e7bb08401 service swift] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:56.837059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:56.839851 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:56.840153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:56.840461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] PATH_INFO: `/v3/projects/15c4256dc55e466d95808fa66f72c37d` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:56.842162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c4256dc55e466d95808fa66f72c37d)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:56.844280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:56.915349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c4256dc55e466d95808fa66f72c37d', 'request_id': 'req-45fb7ebe-2e50-460f-822f-fc61a2470860'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.926656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c4256dc55e466d95808fa66f72c37d', 'request_id': 'req-45fb7ebe-2e50-460f-822f-fc61a2470860'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.934019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c4256dc55e466d95808fa66f72c37d', 'request_id': 'req-45fb7ebe-2e50-460f-822f-fc61a2470860'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.948289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] The token cache is being invalidate because project 15c4256dc55e466d95808fa66f72c37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:58:56.948894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.949571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-45fb7ebe-2e50-460f-822f-fc61a2470860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:58:56.951620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1140/2289] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:58:56 2022] DELETE /identity/v3/projects/15c4256dc55e466d95808fa66f72c37d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:56.959039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:56.959327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:56.960877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:56.988558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:56.990441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:57.058462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1150/2290] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:57.066693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.066972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.067248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.087790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:57.089187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:57.099747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1141/2291] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:57.104941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.115867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac465fad-d7dc-47fe-b18c-9fb60bfa5a45 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.121120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.121790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.122069 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.122340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.123086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:58:57.123390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.125049 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.142253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1151/2292] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:58:57.143397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.152396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2e9ac-00d8-4a32-b1fa-8361ec9f4eb7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.157134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.157784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.158056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.158328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.159040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.161077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.202714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1142/2293] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:58:57 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:58:57.206338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.218692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0b583-3166-47b0-aa06-49a863fb9d54 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.284500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.285340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.285624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.285898 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.286640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.289107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.315610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1152/2294] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:58:57 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:58:57.319373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.329600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d187c-fbde-43ff-a921-40bfd5f906a1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.334260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.334925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.335199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.335462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.336198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.337838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.354069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1143/2295] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 02:58:57.355304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.368762 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dc34b-27cf-4946-a22f-6e12cb9fb9c9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.374906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cb026-1665-44f7-9668-47f59d416b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.375666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cb026-1665-44f7-9668-47f59d416b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.375948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cb026-1665-44f7-9668-47f59d416b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.376398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cb026-1665-44f7-9668-47f59d416b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.377197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cb026-1665-44f7-9668-47f59d416b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.379051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cb026-1665-44f7-9668-47f59d416b41 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.395798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1153/2296] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:58:57.399910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.411832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff074d5-08cf-4b2d-b57a-af20e45efa79 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.439821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.441680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.441935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.442214 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] PATH_INFO: `/v3/projects/9b99e1627a244ae0aeff0419ee0c91a6/users/e53d011b7298432c8dfb171b479c2648/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.465238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b99e1627a244ae0aeff0419ee0c91a6, user_id=e53d011b7298432c8dfb171b479c2648, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.469429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.513149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1144/2297] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:58:57 2022] PUT /identity/v3/projects/9b99e1627a244ae0aeff0419ee0c91a6/users/e53d011b7298432c8dfb171b479c2648/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:58:57.521082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.522081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.522439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.586046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] MFA Rules not processed for user `e53d011b7298432c8dfb171b479c2648`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:58:57.593568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:57.724827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1154/2298] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:58:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:58:57.739044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:58:57.745028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:58:57.837945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18294-592c-421c-aeb2-a88981ec6c28 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:58:57.849569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:58:57.850319 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:58:57.854271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:58:57.856238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:58:57.867841 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:58:57.869886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:58:57.895831 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1145/2299] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:58:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:59:16.568992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:16.570514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:16.630214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c270e4-7362-4196-9e76-135c447d53a9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:16.633800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:16.634441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:16.634715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:16.634983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:16.636842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:16.698505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:16.699966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:16.709596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1155/2300] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:59:39.131977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.133584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:39.265103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a80a1-a6b9-4d26-a7a5-ddfad8f7986e service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.270106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.270997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.271275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.271546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] PATH_INFO: `/v3/users/087b5f4f3891413b8b7fa727768c09a4` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.272925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087b5f4f3891413b8b7fa727768c09a4)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.274861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.330651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087b5f4f3891413b8b7fa727768c09a4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.338350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087b5f4f3891413b8b7fa727768c09a4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.338997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087b5f4f3891413b8b7fa727768c09a4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.345598 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087b5f4f3891413b8b7fa727768c09a4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.357182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087b5f4f3891413b8b7fa727768c09a4'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.363591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1146/2301] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:59:39 2022] DELETE /identity/v3/users/087b5f4f3891413b8b7fa727768c09a4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:39.379065 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.419210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee21e5-be15-4d14-9bbb-be6c32cb5bce service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.484978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.486046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.486447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.486784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] PATH_INFO: `/v3/users/e53d011b7298432c8dfb171b479c2648` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.488082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53d011b7298432c8dfb171b479c2648)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.490156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.542406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53d011b7298432c8dfb171b479c2648'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.542802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53d011b7298432c8dfb171b479c2648'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.543797 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.545310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:39.552192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53d011b7298432c8dfb171b479c2648'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.561018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97875f-c5a1-476a-8503-ab348145b262 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.564146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53d011b7298432c8dfb171b479c2648'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.565917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.566777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.567049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.567316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] PATH_INFO: `/v3/projects/ff777728bb704feeabf264e753679daa` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.568582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff777728bb704feeabf264e753679daa)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.571943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.575735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bcc8b4ae-151d-4249-b2db-0315ab3655ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53d011b7298432c8dfb171b479c2648'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.584125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1156/2302] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:59:39 2022] DELETE /identity/v3/users/e53d011b7298432c8dfb171b479c2648 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:39.588534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.588849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.589134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.616382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:39.617621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:39.621642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff777728bb704feeabf264e753679daa', 'request_id': 'req-51f96dc8-726d-4f3c-8a1e-82a371fe5588'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.629063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff777728bb704feeabf264e753679daa', 'request_id': 'req-51f96dc8-726d-4f3c-8a1e-82a371fe5588'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.635635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff777728bb704feeabf264e753679daa', 'request_id': 'req-51f96dc8-726d-4f3c-8a1e-82a371fe5588'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.645843 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] The token cache is being invalidate because project ff777728bb704feeabf264e753679daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:59:39.646127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.646863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-51f96dc8-726d-4f3c-8a1e-82a371fe5588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:39.648341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1147/2303] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:59:39 2022] DELETE /identity/v3/projects/ff777728bb704feeabf264e753679daa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:39.654051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4651-c7ed-4112-8124-ab33eda35528 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.654339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4651-c7ed-4112-8124-ab33eda35528 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.654609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4651-c7ed-4112-8124-ab33eda35528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.674304 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1157/2304] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:59:39.684181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.685542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:39.693703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-98cf4651-c7ed-4112-8124-ab33eda35528 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:39.694865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-98cf4651-c7ed-4112-8124-ab33eda35528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:39.702651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1148/2305] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:59:39.710364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109747-089e-40dd-b634-140c4568d519 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.710645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109747-089e-40dd-b634-140c4568d519 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.710913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109747-089e-40dd-b634-140c4568d519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.733300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-68109747-089e-40dd-b634-140c4568d519 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:39.734408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-68109747-089e-40dd-b634-140c4568d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:39.742178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1149/2306] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:39.746252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68109747-089e-40dd-b634-140c4568d519 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.754871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68109747-089e-40dd-b634-140c4568d519 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.759566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.760197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.760473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.760772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.761509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:59:39.761807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.763411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.775162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1150/2307] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:59:39.777743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512b5a-b52f-4571-9a13-7171abe76504 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.779118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.781718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.782387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.782678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.782946 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.788756 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9fe32-f659-40b6-a1d3-5d219ba087ea admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.793371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.793762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.794595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.794926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.795044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.795508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.796253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.798300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.805171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1158/2308] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:59:39.829317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1151/2309] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:59:39 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:59:39.830489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.839984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb5095-207b-4bf1-ae3a-fdd55ecd758b service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.897378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.898046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.898371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.898607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.899289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.901331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.923654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1159/2310] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:59:39 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:59:39.924904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.935363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf987d5-b914-4f28-9829-3589735974c3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.945839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.946314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.946629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.946955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.948138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.950249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.961784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1152/2311] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:39.965671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:39.975802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717e00d-4a36-4e16-97c4-364284aa0e69 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:39.981107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18fd36-299a-4972-b479-1d05d0fa6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:39.981768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18fd36-299a-4972-b479-1d05d0fa6783 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:39.982050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18fd36-299a-4972-b479-1d05d0fa6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:39.982319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18fd36-299a-4972-b479-1d05d0fa6783 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:39.983063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18fd36-299a-4972-b479-1d05d0fa6783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:39.984775 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18fd36-299a-4972-b479-1d05d0fa6783 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:39.995209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1160/2312] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:39.999246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.009763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1c0b-f085-4047-a300-99684f3a6f03 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.014552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.015433 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.015707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.015975 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] PATH_INFO: `/v3/projects/64616ad6a14e4b9991b06da4cdd3cc85/users/eda374ce24cc42179c751ea59475be03/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.031522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64616ad6a14e4b9991b06da4cdd3cc85, user_id=eda374ce24cc42179c751ea59475be03, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.034223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.048517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1153/2313] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:59:39 2022] PUT /identity/v3/projects/64616ad6a14e4b9991b06da4cdd3cc85/users/eda374ce24cc42179c751ea59475be03/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:59:40.059876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.060235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.060515 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.072823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.074576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.103866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] MFA Rules not processed for user `eda374ce24cc42179c751ea59475be03`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:40.105741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.140930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83fad-bec0-41b7-8d44-1ca549156de9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.145600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.146454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.146729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.146992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] PATH_INFO: `/v3/projects/9b99e1627a244ae0aeff0419ee0c91a6` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.148420 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b99e1627a244ae0aeff0419ee0c91a6)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.150426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.168671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1161/2314] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:40.178665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.180048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.201120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b99e1627a244ae0aeff0419ee0c91a6', 'request_id': 'req-ab1cf2f7-49fe-4209-9415-856b47de52f5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:40.209162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b99e1627a244ae0aeff0419ee0c91a6', 'request_id': 'req-ab1cf2f7-49fe-4209-9415-856b47de52f5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:40.215442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b99e1627a244ae0aeff0419ee0c91a6', 'request_id': 'req-ab1cf2f7-49fe-4209-9415-856b47de52f5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:40.225772 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] The token cache is being invalidate because project 9b99e1627a244ae0aeff0419ee0c91a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:59:40.226398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:40.227188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ab1cf2f7-49fe-4209-9415-856b47de52f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:40.229437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1154/2315] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:59:40 2022] DELETE /identity/v3/projects/9b99e1627a244ae0aeff0419ee0c91a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:59:40.234930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cce59-6336-4dbd-a778-48387620df1b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.235152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cce59-6336-4dbd-a778-48387620df1b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.235423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cce59-6336-4dbd-a778-48387620df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.235826 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a10cc-fa05-4602-9042-2a1b048bf002 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.254130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b58cce59-6336-4dbd-a778-48387620df1b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:40.255461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b58cce59-6336-4dbd-a778-48387620df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.284979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.285664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.285977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.286255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.288784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.332813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1155/2316] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:40.339777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.340136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.340482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.354199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.355741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.359118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:40.360312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.365967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1162/2317] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 02:59:40.368618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1156/2318] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 02:59:40.373299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.383871 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a767-fd29-4a00-acdb-2c9b891e6fe5 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.388598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.389313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.390169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.390169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.390566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:59:40.390879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.392529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.404487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1163/2319] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 02:59:40.408799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.418036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b62e7-22b5-4d1a-9848-f1ec937abd62 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.427160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.427160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.427160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.427160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.427561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.427561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.452916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1157/2320] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:59:40 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:59:40.457251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.466940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7dac4-ad2a-4bff-a7fc-738b27ad7d92 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.526041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.526713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.526989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.527259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.528187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.530501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.552283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1164/2321] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:59:40 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:59:40.556461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.566804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57929-383f-4f11-ba4f-f391223863f3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.572493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.573191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.573466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.573732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.574509 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.576108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.587288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1158/2322] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:40.591487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.612702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915368b7-0ff8-4226-bf22-5be1bea01c68 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.617911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0ad5e-5f96-463a-8d69-b0be986a63bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.618610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ad5e-5f96-463a-8d69-b0be986a63bb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.618917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ad5e-5f96-463a-8d69-b0be986a63bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.619246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ad5e-5f96-463a-8d69-b0be986a63bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.620086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0ad5e-5f96-463a-8d69-b0be986a63bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.621812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0ad5e-5f96-463a-8d69-b0be986a63bb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.635681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1165/2323] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:40.636891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.647687 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552ce8-764f-412f-8405-89dd6f5e79ae admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.654048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.655003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.655314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.655847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] PATH_INFO: `/v3/projects/e008be6979934b62a802bdb8bc16d3bd/users/b1f7f4842b194cc1a070414ed49b60e0/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.671596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e008be6979934b62a802bdb8bc16d3bd, user_id=b1f7f4842b194cc1a070414ed49b60e0, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.674476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.687330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1159/2324] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:59:40 2022] PUT /identity/v3/projects/e008be6979934b62a802bdb8bc16d3bd/users/b1f7f4842b194cc1a070414ed49b60e0/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:59:40.699776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.700126 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.700426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.728097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] MFA Rules not processed for user `b1f7f4842b194cc1a070414ed49b60e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:40.729334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.808422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1166/2325] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:40.824056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:40.827175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:40.886375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9833e63-ccf7-42a1-a41c-b24c6570d110 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:40.890368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:40.891008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:40.891282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:40.891549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:40.900460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:40.901928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:40.910599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1160/2326] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:59:45.963726 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:45.965807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:46.082431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaaa3c-351f-4ba2-90e9-734aa619426f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:46.088748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:46.089387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:46.089667 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:46.089939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:46.091903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:46.104291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:46.105940 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144d4a-f26d-4e0c-8c40-b97740be2764 service placement] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:46.115963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1167/2327] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:59:54.967878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:54.969533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:55.034259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45d9f-83ca-4e9b-945d-beff09db10d8 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:55.039577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:55.040452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.040751 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.041041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] PATH_INFO: `/v3/users/eda374ce24cc42179c751ea59475be03` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.042338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda374ce24cc42179c751ea59475be03)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:55.044266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:55.107415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda374ce24cc42179c751ea59475be03'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.115881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda374ce24cc42179c751ea59475be03'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.116525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda374ce24cc42179c751ea59475be03'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.123958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda374ce24cc42179c751ea59475be03'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.137225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda374ce24cc42179c751ea59475be03'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.143794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1161/2328] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:59:54 2022] DELETE /identity/v3/users/eda374ce24cc42179c751ea59475be03 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:55.148446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.148998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.148998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.167470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:55.168663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:55.231913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1168/2329] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:55.243585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:55.244950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:55.310273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfcc46-7602-425f-8138-53c1092c9bd7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:55.314616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92412ab5-9aec-400d-9a5d-a977f58a6af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:55.315268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412ab5-9aec-400d-9a5d-a977f58a6af9 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.315656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412ab5-9aec-400d-9a5d-a977f58a6af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.315931 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412ab5-9aec-400d-9a5d-a977f58a6af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.326343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92412ab5-9aec-400d-9a5d-a977f58a6af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:55.327783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92412ab5-9aec-400d-9a5d-a977f58a6af9 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:55.338102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1162/2330] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:59:55.663604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:55.666124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:55.680927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df1f08-1d33-4ef4-8a0f-69f72656b201 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:55.686104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:55.687167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.687433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.687978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] PATH_INFO: `/v3/projects/64616ad6a14e4b9991b06da4cdd3cc85` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.689620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64616ad6a14e4b9991b06da4cdd3cc85)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:55.692056 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:55.749008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64616ad6a14e4b9991b06da4cdd3cc85', 'request_id': 'req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.755251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64616ad6a14e4b9991b06da4cdd3cc85', 'request_id': 'req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.760446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64616ad6a14e4b9991b06da4cdd3cc85', 'request_id': 'req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.773286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] The token cache is being invalidate because project 64616ad6a14e4b9991b06da4cdd3cc85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 02:59:55.773586 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.774178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-bc9a56af-6b4c-41cc-9420-f7ba5c7ee74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:55.775741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1169/2331] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:59:55 2022] DELETE /identity/v3/projects/64616ad6a14e4b9991b06da4cdd3cc85 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:55.781489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.781776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.782050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.810968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:55.812188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:55.870720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1163/2332] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:55.879018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.879299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.879573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.899216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:55.900681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:55.910134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1170/2333] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:55.914800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:55.924568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e5c9f-8c2e-45f4-b843-0019d5298ca8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:55.930312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:55.930964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.931232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.931522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.932259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 02:59:55.932552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:55.934207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:55.946052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1164/2334] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 02:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 02:59:55.950257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:55.959416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ecd19-024a-4f6f-af1e-0c804e7d9564 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:55.964306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:55.964974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:55.965250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:55.965517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:55.966205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:55.968130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:55.995031 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1171/2335] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:59:55 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 02:59:55.999418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:56.010285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a999-fe0e-4683-b6b8-77589d0c4fac admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:56.065842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:56.067007 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.067275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.067538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:56.068259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:56.070268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:56.093686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1165/2336] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:59:55 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:59:56.097962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:56.108552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8ac0-1e46-4289-8171-bd60a08591fd admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:56.113268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:56.114331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.114331 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.114528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:56.115210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:56.116808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:56.128768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1172/2337] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:56.132900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:56.142940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7d25-5400-426b-9b35-5989b13e65bb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:56.147544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921ecb-a5d2-48d2-aec0-04482fbfaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:56.148206 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921ecb-a5d2-48d2-aec0-04482fbfaf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.148487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921ecb-a5d2-48d2-aec0-04482fbfaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.148776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921ecb-a5d2-48d2-aec0-04482fbfaf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:56.149547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921ecb-a5d2-48d2-aec0-04482fbfaf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:56.151142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921ecb-a5d2-48d2-aec0-04482fbfaf1b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:56.161143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1166/2338] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:56.165324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:56.175409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9627-21fd-472a-9271-447758837b5e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:56.179965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:56.181019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.181240 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.181455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] PATH_INFO: `/v3/projects/437727531c234a159518af15a582641f/users/76908a819d9e42babb4428bbf219f340/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:56.196140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=437727531c234a159518af15a582641f, user_id=76908a819d9e42babb4428bbf219f340, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:56.198886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:56.213536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1173/2339] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:59:56 2022] PUT /identity/v3/projects/437727531c234a159518af15a582641f/users/76908a819d9e42babb4428bbf219f340/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 02:59:56.218803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942468c4-1f7c-44c7-b3a0-9c22e956e5f7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.219219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942468c4-1f7c-44c7-b3a0-9c22e956e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.219441 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942468c4-1f7c-44c7-b3a0-9c22e956e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:56.240785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-942468c4-1f7c-44c7-b3a0-9c22e956e5f7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:56.242103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-942468c4-1f7c-44c7-b3a0-9c22e956e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:56.299761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1167/2340] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:56.309738 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:56.311478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:56.369746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de1ce5-28b8-4aa4-a609-4cc7c8293616 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:56.374073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:56.374772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.375043 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.375310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:56.384710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:56.386171 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:56.395475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1174/2341] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 02:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 02:59:56.991697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:56.991989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:56.992281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.021938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] MFA Rules not processed for user `76908a819d9e42babb4428bbf219f340`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:57.024059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:57.094494 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1168/2342] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:57.099446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:57.109527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bd2d-f4e3-4af3-ae7f-c0bf89da6631 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:57.114396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:57.115051 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:57.115336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:57.115606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.116326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:57.118263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:57.145143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1175/2343] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 02:59:57 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:59:57.149158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:57.159769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01aa9-a145-47a1-8d92-772d3d37e9b2 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:57.218333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:57.219058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:57.219344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:57.219602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.220306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:57.222853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:57.246585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1169/2344] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 02:59:57 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 02:59:57.250560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:57.267362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d116f-5c41-4b6f-9e7f-b079a5e23a09 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:57.274976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:57.277296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:57.277807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:57.278151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.279033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:57.280989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:57.292618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1176/2345] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:57.296776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:57.306720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfef120-681f-4d22-8680-5df52b462999 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:57.311332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:57.312203 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:57.312476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:57.312771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] PATH_INFO: `/v3/projects/536005fe11134c27b92d96bdca8670f2/users/145c486d74f743ee85face627ea4821b/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.327253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536005fe11134c27b92d96bdca8670f2, user_id=145c486d74f743ee85face627ea4821b, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:57.329907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:57.344408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1170/2346] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:59:57 2022] PUT /identity/v3/projects/536005fe11134c27b92d96bdca8670f2/users/145c486d74f743ee85face627ea4821b/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:57.350041 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:57.360336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d9d8b-e8be-40ae-9725-463d9695f236 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:57.415486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314f3f2-cfa4-432c-8e07-4a8554ddef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:57.416158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314f3f2-cfa4-432c-8e07-4a8554ddef79 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:57.416462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314f3f2-cfa4-432c-8e07-4a8554ddef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:57.416752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314f3f2-cfa4-432c-8e07-4a8554ddef79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.417514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314f3f2-cfa4-432c-8e07-4a8554ddef79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:57.419124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314f3f2-cfa4-432c-8e07-4a8554ddef79 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:57.429024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1177/2347] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 02:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 02:59:57.433544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:57.443828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6c93-3da7-4825-84de-5803ded51b18 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:57.449111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:57.449992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:57.450275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:57.450572 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] PATH_INFO: `/v3/projects/536005fe11134c27b92d96bdca8670f2/users/145c486d74f743ee85face627ea4821b/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:57.452786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536005fe11134c27b92d96bdca8670f2, user_id=145c486d74f743ee85face627ea4821b, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:57.455394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:57.466072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1171/2348] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 02:59:57 2022] PUT /identity/v3/projects/536005fe11134c27b92d96bdca8670f2/users/145c486d74f743ee85face627ea4821b/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:58.409959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:58.410459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:58.410541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:58.438502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] MFA Rules not processed for user `145c486d74f743ee85face627ea4821b`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 02:59:58.439717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 02:59:58.517904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1178/2349] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 02:59:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 02:59:59.496917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:59.560321 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5491f2-97ad-4e1d-a31b-e8f179181423 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:59.564917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:59.565905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:59.566181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:59.566480 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] PATH_INFO: `/v3/users/76908a819d9e42babb4428bbf219f340` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:59.567697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76908a819d9e42babb4428bbf219f340)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:59.569699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:59.626073 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76908a819d9e42babb4428bbf219f340'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.635291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76908a819d9e42babb4428bbf219f340'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.635893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76908a819d9e42babb4428bbf219f340'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.643001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76908a819d9e42babb4428bbf219f340'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.654604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76908a819d9e42babb4428bbf219f340'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.660691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1172/2350] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 02:59:59 2022] DELETE /identity/v3/users/76908a819d9e42babb4428bbf219f340 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 02:59:59.837283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 02:59:59.848882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc07b-da67-47d9-9107-6470b47fb37a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 02:59:59.917600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 02:59:59.918492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 02:59:59.918768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 02:59:59.919037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] PATH_INFO: `/v3/projects/437727531c234a159518af15a582641f` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 02:59:59.920305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=437727531c234a159518af15a582641f)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 02:59:59.922313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 02:59:59.974969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437727531c234a159518af15a582641f', 'request_id': 'req-a88598ef-8bfb-49fe-b841-c1dd711940cf'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.982674 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437727531c234a159518af15a582641f', 'request_id': 'req-a88598ef-8bfb-49fe-b841-c1dd711940cf'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 02:59:59.989526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437727531c234a159518af15a582641f', 'request_id': 'req-a88598ef-8bfb-49fe-b841-c1dd711940cf'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.004305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] The token cache is being invalidate because project 437727531c234a159518af15a582641f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:00.004576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.005300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.006932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1179/2351] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 02:59:59 2022] DELETE /identity/v3/projects/437727531c234a159518af15a582641f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:00.011274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.012959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.027183 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b714-4ba3-4b98-a863-a1f1636b8a35 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.087484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.088365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.088643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.088957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] PATH_INFO: `/v3/users/145c486d74f743ee85face627ea4821b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.093128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145c486d74f743ee85face627ea4821b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.095752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.100265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.102087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.115081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88598ef-8bfb-49fe-b841-c1dd711940cf admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.120968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.121751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.122037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.122310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] PATH_INFO: `/v3/users/b1f7f4842b194cc1a070414ed49b60e0` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.123727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f7f4842b194cc1a070414ed49b60e0)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.127329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.150065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145c486d74f743ee85face627ea4821b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.159481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145c486d74f743ee85face627ea4821b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.160072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145c486d74f743ee85face627ea4821b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.166924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145c486d74f743ee85face627ea4821b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.175146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f7f4842b194cc1a070414ed49b60e0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.175818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f7f4842b194cc1a070414ed49b60e0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.178546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6427823-0551-47ec-87b2-098cc93f3ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145c486d74f743ee85face627ea4821b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.182879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f7f4842b194cc1a070414ed49b60e0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.184397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1173/2352] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:00 2022] DELETE /identity/v3/users/145c486d74f743ee85face627ea4821b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:00.194447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f7f4842b194cc1a070414ed49b60e0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.201740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f7f4842b194cc1a070414ed49b60e0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.207825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1180/2353] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:00 2022] DELETE /identity/v3/users/b1f7f4842b194cc1a070414ed49b60e0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:00.212419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.212700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.213016 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.230608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:00.231806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.301076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1174/2354] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:00:00.310988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.312523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.368201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.369727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.383315 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed8d88-8fbc-4039-a234-c0aefaca3a75 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.389097 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.390013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.390417 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.390698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] PATH_INFO: `/v3/projects/536005fe11134c27b92d96bdca8670f2` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.392040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] RBAC: Authorizing `identity:delete_project(project_id=536005fe11134c27b92d96bdca8670f2)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.393137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15ffb-2006-452f-acb6-473b3106656e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.394084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.398755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13e796-fd4a-41e0-bc76-9ddc765245a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.399513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13e796-fd4a-41e0-bc76-9ddc765245a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.399830 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13e796-fd4a-41e0-bc76-9ddc765245a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.400172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13e796-fd4a-41e0-bc76-9ddc765245a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.410192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13e796-fd4a-41e0-bc76-9ddc765245a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.411635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13e796-fd4a-41e0-bc76-9ddc765245a6 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.421333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1181/2355] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:00.440039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536005fe11134c27b92d96bdca8670f2', 'request_id': 'req-ff3fa5ca-4b28-4f41-a1fc-58954930407c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.447997 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536005fe11134c27b92d96bdca8670f2', 'request_id': 'req-ff3fa5ca-4b28-4f41-a1fc-58954930407c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.454137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536005fe11134c27b92d96bdca8670f2', 'request_id': 'req-ff3fa5ca-4b28-4f41-a1fc-58954930407c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.464227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] The token cache is being invalidate because project 536005fe11134c27b92d96bdca8670f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:00.464575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.465294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff3fa5ca-4b28-4f41-a1fc-58954930407c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.467250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1175/2356] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:00 2022] DELETE /identity/v3/projects/536005fe11134c27b92d96bdca8670f2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:00.475823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.476367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.476663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.497237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:00.498740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.556867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1182/2357] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:00.564524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.564993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.565345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.584089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:00.585305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.594093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1176/2358] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:00.600180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.610426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043ef6-74bf-4e28-acda-b409b10ac5d9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.620480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.621290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.621559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.622044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.622919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:00.623197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.624901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.637140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1183/2359] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:00.641790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.652603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2377f9-52d1-4830-bb74-39d44508938a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.658866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.659671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.660017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.660350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.661190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.663343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.700479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1177/2360] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:00 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:00.704745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.716215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3a68-1819-417f-95c5-32ce93bb8e88 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.726555 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.728238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.783235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.783928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.784601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.784601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.785287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.787236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.794602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab721a-75eb-43f3-8ce5-be5580ad4a45 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.799933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.800763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.801051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.801329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] PATH_INFO: `/v3/projects/e008be6979934b62a802bdb8bc16d3bd` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.802645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e008be6979934b62a802bdb8bc16d3bd)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.804702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.812398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1184/2361] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:00 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:00:00.813851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.826201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3b63-c8bd-409b-ac9b-d816752b3362 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.830815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.831686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.831967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.832256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.833101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.834820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.844705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1185/2362] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:00.848581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.852300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e008be6979934b62a802bdb8bc16d3bd', 'request_id': 'req-b934402a-21ec-4ef6-87d5-c23b061148d5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.858382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b39a-54a2-44bf-b3e3-048720cbf6e2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.860683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e008be6979934b62a802bdb8bc16d3bd', 'request_id': 'req-b934402a-21ec-4ef6-87d5-c23b061148d5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.867044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e008be6979934b62a802bdb8bc16d3bd', 'request_id': 'req-b934402a-21ec-4ef6-87d5-c23b061148d5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.877300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] The token cache is being invalidate because project e008be6979934b62a802bdb8bc16d3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:00.877579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.878247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:00.892779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1178/2363] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:00 2022] DELETE /identity/v3/projects/e008be6979934b62a802bdb8bc16d3bd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:00.915545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f427d-ab6c-429d-9faf-9e0f613a94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.916362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f427d-ab6c-429d-9faf-9e0f613a94ef admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.916703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f427d-ab6c-429d-9faf-9e0f613a94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.917067 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f427d-ab6c-429d-9faf-9e0f613a94ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.917915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f427d-ab6c-429d-9faf-9e0f613a94ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.919605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f427d-ab6c-429d-9faf-9e0f613a94ef admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.930923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1186/2364] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:00.935076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:00.936508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:00.949832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934402a-21ec-4ef6-87d5-c23b061148d5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:00.954613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:00.955527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:00.955805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:00.957224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] PATH_INFO: `/v3/projects/2842e521dba943189a9c16b518b1f8de/users/df65dc0545d84dd9a70495c02ef554ce/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:00.974106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2842e521dba943189a9c16b518b1f8de, user_id=df65dc0545d84dd9a70495c02ef554ce, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:00.977369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:00.994704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1179/2365] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:00 2022] PUT /identity/v3/projects/2842e521dba943189a9c16b518b1f8de/users/df65dc0545d84dd9a70495c02ef554ce/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:01.005555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.005841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.006115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.036038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] MFA Rules not processed for user `df65dc0545d84dd9a70495c02ef554ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:01.037281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:01.104499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1187/2366] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:01.109864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.177973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f904e1-5cef-49dd-9d86-e4bc63d2fd31 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.183054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.183707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.183981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.184222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.184966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.186849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.213196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1180/2367] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:01 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:01.217350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.228877 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484cb81-9ad6-438c-a25e-b66f9309f520 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.296583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.297305 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.297557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.297838 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.298559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.300539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.322626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1188/2368] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:01 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:00:01.326922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.337566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fb09-9b5a-4f40-a201-5bddc2760810 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.342247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.343062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.343344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.343614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.344336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.345970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.356979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1181/2369] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:01.361261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.371448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e48be-c05e-4406-ad4e-c58fa28768b7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.377352 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.378991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.379300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.379579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] PATH_INFO: `/v3/projects/7ce9386d02e540189569bca611283ed1/users/a21957588fbd490e9b6360cfd15c0265/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.395817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce9386d02e540189569bca611283ed1, user_id=a21957588fbd490e9b6360cfd15c0265, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.398589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.412477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1189/2370] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:01 2022] PUT /identity/v3/projects/7ce9386d02e540189569bca611283ed1/users/a21957588fbd490e9b6360cfd15c0265/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:01.416505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.426473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929eb2-f698-4a33-93be-bec52cb5cf21 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.481674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db94f1-26f7-4320-affd-2784d884f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.482338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db94f1-26f7-4320-affd-2784d884f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.482622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db94f1-26f7-4320-affd-2784d884f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.482878 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db94f1-26f7-4320-affd-2784d884f6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.483614 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db94f1-26f7-4320-affd-2784d884f6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.485254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db94f1-26f7-4320-affd-2784d884f6ba admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.494871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1182/2371] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:01.499046 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.510613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8833ad7-3b4f-460d-935a-9bdcd5f43cb4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.516062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.517256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.517447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.517536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] PATH_INFO: `/v3/projects/7ce9386d02e540189569bca611283ed1/users/a21957588fbd490e9b6360cfd15c0265/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.520070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce9386d02e540189569bca611283ed1, user_id=a21957588fbd490e9b6360cfd15c0265, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.522766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.535318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1190/2372] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:01 2022] PUT /identity/v3/projects/7ce9386d02e540189569bca611283ed1/users/a21957588fbd490e9b6360cfd15c0265/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:01.546978 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.547290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.547562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.575201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] MFA Rules not processed for user `a21957588fbd490e9b6360cfd15c0265`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:01.576399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:01.644652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1183/2373] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:01.655092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.657144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:01.745565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8165-481a-4254-966f-cc257ffef9f4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.749840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229fcce-9af5-4e3a-8634-6e96e39b2bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.750460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229fcce-9af5-4e3a-8634-6e96e39b2bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.750741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229fcce-9af5-4e3a-8634-6e96e39b2bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.751042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229fcce-9af5-4e3a-8634-6e96e39b2bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.760832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229fcce-9af5-4e3a-8634-6e96e39b2bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.762271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229fcce-9af5-4e3a-8634-6e96e39b2bb9 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.771787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1191/2374] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:01.834188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:01.897222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840542c-2362-4edd-a40b-65b5796db846 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:01.901870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:01.902752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.903027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.903423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] PATH_INFO: `/v3/users/df65dc0545d84dd9a70495c02ef554ce` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:01.904622 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df65dc0545d84dd9a70495c02ef554ce)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:01.906562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:01.953891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df65dc0545d84dd9a70495c02ef554ce'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:01.962628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df65dc0545d84dd9a70495c02ef554ce'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:01.963275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df65dc0545d84dd9a70495c02ef554ce'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:01.970351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df65dc0545d84dd9a70495c02ef554ce'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:01.982830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df65dc0545d84dd9a70495c02ef554ce'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:01.989557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1184/2375] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:01 2022] DELETE /identity/v3/users/df65dc0545d84dd9a70495c02ef554ce => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:01.994214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:01.994675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:01.994828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:02.013042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:02.014255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:02.074983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1192/2376] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:02.085098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:02.086602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:02.149045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f268713-64ac-49b4-b489-969007ecd31f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:02.153391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:02.154059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:02.154385 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:02.154662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:02.164143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:02.165599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:02.174993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1185/2377] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:02.455394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:02.456970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:02.471007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b42243-b7b0-40d8-a7f7-eaab8675e823 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:02.478385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:02.479263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:02.479536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:02.479802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] PATH_INFO: `/v3/projects/2842e521dba943189a9c16b518b1f8de` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:02.486841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2842e521dba943189a9c16b518b1f8de)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:02.488859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:02.538669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2842e521dba943189a9c16b518b1f8de', 'request_id': 'req-9316c8f7-d3e4-47ba-8a09-41e2f332330e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.544981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2842e521dba943189a9c16b518b1f8de', 'request_id': 'req-9316c8f7-d3e4-47ba-8a09-41e2f332330e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.550494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2842e521dba943189a9c16b518b1f8de', 'request_id': 'req-9316c8f7-d3e4-47ba-8a09-41e2f332330e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.568298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] The token cache is being invalidate because project 2842e521dba943189a9c16b518b1f8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:02.568587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.569242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.570812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1193/2378] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:02 2022] DELETE /identity/v3/projects/2842e521dba943189a9c16b518b1f8de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:02.574989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:02.584916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fef286-4058-4a24-883d-e6468aa7e0c5 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:02.640703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:02.641660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:02.641939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:02.642205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] PATH_INFO: `/v3/users/a21957588fbd490e9b6360cfd15c0265` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:02.643578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21957588fbd490e9b6360cfd15c0265)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:02.645613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:02.693444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21957588fbd490e9b6360cfd15c0265'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.702155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21957588fbd490e9b6360cfd15c0265'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.702702 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21957588fbd490e9b6360cfd15c0265'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.709970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21957588fbd490e9b6360cfd15c0265'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.722429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7e062060-d34f-4560-bc4c-fed194ec4a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21957588fbd490e9b6360cfd15c0265'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:02.728909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1186/2379] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:02 2022] DELETE /identity/v3/users/a21957588fbd490e9b6360cfd15c0265 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:03.002938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.005089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:03.019816 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c8f7-d3e4-47ba-8a09-41e2f332330e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.078555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.079446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.080024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.080311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] PATH_INFO: `/v3/projects/7ce9386d02e540189569bca611283ed1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.081756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce9386d02e540189569bca611283ed1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.083801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.133166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce9386d02e540189569bca611283ed1', 'request_id': 'req-e38053a3-264b-4f5c-8f87-8def77c0522d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:03.139484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce9386d02e540189569bca611283ed1', 'request_id': 'req-e38053a3-264b-4f5c-8f87-8def77c0522d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:03.145020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce9386d02e540189569bca611283ed1', 'request_id': 'req-e38053a3-264b-4f5c-8f87-8def77c0522d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:03.158369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] The token cache is being invalidate because project 7ce9386d02e540189569bca611283ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:03.159212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:03.159856 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e38053a3-264b-4f5c-8f87-8def77c0522d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:03.161442 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1194/2380] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:03 2022] DELETE /identity/v3/projects/7ce9386d02e540189569bca611283ed1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:03.167473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.167827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.168191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.186191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:03.187375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:03.245661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1187/2381] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:03.253603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.253883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.254152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.272950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:03.274128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:03.282459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1195/2382] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:03.286769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.296364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60b602-a9cc-40e3-97f4-e677382229a9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.301514 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.302160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.302432 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.302704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.303451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:03.303750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.305382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.318121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1188/2383] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:03.325122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.339643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff2cdf-8fc5-4df9-9d05-61edc9067c99 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.346818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.347459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.347730 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.348019 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.348772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.351102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.382121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1196/2384] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:03.387266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.402744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5eef6-b08c-46ed-8441-ce16258ca35d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.464448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.465136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.465414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.465689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.466410 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.468358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.490775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1189/2385] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:03.495103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.505715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa6ef-79f2-4379-9b0f-baf7d0fd61b0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.510782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.511431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.511705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.511973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.512734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.514317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.524965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1197/2386] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:03.528893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.539864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc34cc-3d72-4a95-a0db-9f129d2f918b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.545216 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a512329-68e5-4fb2-84ce-92f527c18741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.545865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a512329-68e5-4fb2-84ce-92f527c18741 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.546143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a512329-68e5-4fb2-84ce-92f527c18741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.546381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a512329-68e5-4fb2-84ce-92f527c18741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.547121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a512329-68e5-4fb2-84ce-92f527c18741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.548707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a512329-68e5-4fb2-84ce-92f527c18741 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.558771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1190/2387] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:03.562879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.572949 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04921df4-165c-4f6e-8e7c-708b2c9130f0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.578683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.579572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.579851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.580120 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] PATH_INFO: `/v3/projects/af3918b3eaaf400c80e04274a15ec69e/users/97bafaa580c947269cc1ac0a4452c571/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.595796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3918b3eaaf400c80e04274a15ec69e, user_id=97bafaa580c947269cc1ac0a4452c571, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.598597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.613634 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1198/2388] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:03 2022] PUT /identity/v3/projects/af3918b3eaaf400c80e04274a15ec69e/users/97bafaa580c947269cc1ac0a4452c571/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:03.624137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.624607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.624701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.656301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] MFA Rules not processed for user `97bafaa580c947269cc1ac0a4452c571`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:03.657576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:03.726135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1191/2389] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:03.730610 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.791632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584877-6645-4fc7-8c40-9734ca391a4d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.798238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.798910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.799191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.799461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.800280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.802205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.828753 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1199/2390] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:03.833083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.843728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1804-8632-4c50-aa37-a84f38ec20c6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.900392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.901099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.901375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.901671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.902406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.904314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.927213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1192/2391] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:03 2022] POST /identity/v3/users => generated 307 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:03.928439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.938526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d610d13-3eda-40e9-b9fb-c549d6a3d842 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.943170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.943833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.944112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.944386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.945160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.946771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:03.958924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1200/2392] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:03.963200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:03.972940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7c087-da13-4911-8234-74b88ef979e8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:03.977836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:03.978711 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:03.978987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:03.979256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] PATH_INFO: `/v3/projects/9bff32c781834ca7893606656f84b85f/users/0a1deaff8f914dbfbb64ae4ba9f5e68d/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:03.993652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bff32c781834ca7893606656f84b85f, user_id=0a1deaff8f914dbfbb64ae4ba9f5e68d, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:03.996299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:04.009990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1193/2393] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:03 2022] PUT /identity/v3/projects/9bff32c781834ca7893606656f84b85f/users/0a1deaff8f914dbfbb64ae4ba9f5e68d/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:04.014042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:04.024115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36218-ba68-4467-b87e-1ed7e5efdd6e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:04.087564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0dde-77cd-4102-8b80-b6f2e6b0ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:04.088242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0dde-77cd-4102-8b80-b6f2e6b0ba9a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:04.088519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0dde-77cd-4102-8b80-b6f2e6b0ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:04.088827 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0dde-77cd-4102-8b80-b6f2e6b0ba9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:04.089568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc0dde-77cd-4102-8b80-b6f2e6b0ba9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:04.091311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc0dde-77cd-4102-8b80-b6f2e6b0ba9a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:04.102297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1201/2394] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:04.106574 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:04.116677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f80b-8651-4a77-b356-8cd3c2b29ff5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:04.121333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:04.122222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:04.122500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:04.122770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] PATH_INFO: `/v3/projects/9bff32c781834ca7893606656f84b85f/users/0a1deaff8f914dbfbb64ae4ba9f5e68d/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:04.124989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bff32c781834ca7893606656f84b85f, user_id=0a1deaff8f914dbfbb64ae4ba9f5e68d, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:04.127844 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:04.139019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1194/2395] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:04 2022] PUT /identity/v3/projects/9bff32c781834ca7893606656f84b85f/users/0a1deaff8f914dbfbb64ae4ba9f5e68d/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:04.150603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09294933-8b30-45f1-8e0c-059658659095 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:04.150888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09294933-8b30-45f1-8e0c-059658659095 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:04.151158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09294933-8b30-45f1-8e0c-059658659095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:04.177791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-09294933-8b30-45f1-8e0c-059658659095 None None] MFA Rules not processed for user `0a1deaff8f914dbfbb64ae4ba9f5e68d`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:04.179146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-09294933-8b30-45f1-8e0c-059658659095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:04.277340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1202/2396] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:04.283462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:04.285434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:04.385989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691792d4-fd62-4c64-bef0-287bd98dc396 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:04.389921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:04.390576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:04.390850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:04.391260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:04.402917 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:04.405262 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:04.415399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1195/2397] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:04.501473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09294933-8b30-45f1-8e0c-059658659095 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:04.511427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09294933-8b30-45f1-8e0c-059658659095 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:04.515466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a7cc8-f301-4142-8741-dd6459fc4612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:04.516111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7cc8-f301-4142-8741-dd6459fc4612 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:04.516379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7cc8-f301-4142-8741-dd6459fc4612 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:04.516643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7cc8-f301-4142-8741-dd6459fc4612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:04.571628 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a7cc8-f301-4142-8741-dd6459fc4612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:04.573039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a7cc8-f301-4142-8741-dd6459fc4612 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:04.581916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1203/2398] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:08.661170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:08.723422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635193-49fd-4e67-b9ca-d3308fb64ed4 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:08.728915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:08.729870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:08.730205 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:08.730542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] PATH_INFO: `/v3/users/97bafaa580c947269cc1ac0a4452c571` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:08.732020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97bafaa580c947269cc1ac0a4452c571)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:08.734093 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:08.783389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97bafaa580c947269cc1ac0a4452c571'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:08.791984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97bafaa580c947269cc1ac0a4452c571'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:08.792631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97bafaa580c947269cc1ac0a4452c571'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:08.799240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97bafaa580c947269cc1ac0a4452c571'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:08.811686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97bafaa580c947269cc1ac0a4452c571'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:08.818019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1196/2399] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:08 2022] DELETE /identity/v3/users/97bafaa580c947269cc1ac0a4452c571 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:08.822893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:08.823405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:08.823405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:08.840703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:08.841916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:08.901194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1204/2400] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:08.912524 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:08.914022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:08.972940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b502cee-4de4-4c29-830e-9d4965f0cf70 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:08.977792 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:08.978427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:08.978701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:08.978971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:08.991250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:08.992767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:09.005009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1197/2401] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:00:09.285349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:09.286839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:09.300942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a65c1-fd8d-419a-b1f8-b512db83846d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:09.313693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:09.314545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:09.314833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:09.315100 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] PATH_INFO: `/v3/projects/af3918b3eaaf400c80e04274a15ec69e` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:09.316537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3918b3eaaf400c80e04274a15ec69e)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:09.318440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:09.368927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3918b3eaaf400c80e04274a15ec69e', 'request_id': 'req-91128c2e-3df7-4ba5-8623-5a5288767d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.375754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3918b3eaaf400c80e04274a15ec69e', 'request_id': 'req-91128c2e-3df7-4ba5-8623-5a5288767d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.383029 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3918b3eaaf400c80e04274a15ec69e', 'request_id': 'req-91128c2e-3df7-4ba5-8623-5a5288767d60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.396222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] The token cache is being invalidate because project af3918b3eaaf400c80e04274a15ec69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:09.396557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.397309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-91128c2e-3df7-4ba5-8623-5a5288767d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.402054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1205/2402] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:09 2022] DELETE /identity/v3/projects/af3918b3eaaf400c80e04274a15ec69e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:09.403718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:09.415268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807fb4-0fa7-4504-a47d-4bad39206238 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:09.470000 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:09.470865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:09.471144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:09.471442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] PATH_INFO: `/v3/users/0a1deaff8f914dbfbb64ae4ba9f5e68d` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:09.472635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1deaff8f914dbfbb64ae4ba9f5e68d)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:09.474674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:09.533597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1deaff8f914dbfbb64ae4ba9f5e68d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.543104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1deaff8f914dbfbb64ae4ba9f5e68d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.543895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1deaff8f914dbfbb64ae4ba9f5e68d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.552856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1deaff8f914dbfbb64ae4ba9f5e68d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.568864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1deaff8f914dbfbb64ae4ba9f5e68d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:09.580175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1198/2403] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:09 2022] DELETE /identity/v3/users/0a1deaff8f914dbfbb64ae4ba9f5e68d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:09.588939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:09.589980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:09.590264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:09.623751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:09.625151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:09.709114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1206/2404] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 03:00:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:09.762156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:09.763601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:09.838971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5bb20-aadc-41b7-9904-6b77bd5e8599 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:09.845849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a33aa-7bbd-442a-83d9-662a47aa78a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:09.846529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a33aa-7bbd-442a-83d9-662a47aa78a3 service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:09.846804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a33aa-7bbd-442a-83d9-662a47aa78a3 service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:09.847078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a33aa-7bbd-442a-83d9-662a47aa78a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:09.856900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a33aa-7bbd-442a-83d9-662a47aa78a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:09.858521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a33aa-7bbd-442a-83d9-662a47aa78a3 service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:09.868501 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1199/2405] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:00:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:00:09.981846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:09.983925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:10.075010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba7ea-d82c-484f-bf94-ef4af3fd98f9 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.083698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.084229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.084509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.084824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] PATH_INFO: `/v3/projects/9bff32c781834ca7893606656f84b85f` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.086494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bff32c781834ca7893606656f84b85f)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.091085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.157211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bff32c781834ca7893606656f84b85f', 'request_id': 'req-6cb00c4e-6488-4bf8-a10e-d163818f3b60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:10.166233 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bff32c781834ca7893606656f84b85f', 'request_id': 'req-6cb00c4e-6488-4bf8-a10e-d163818f3b60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:10.173519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bff32c781834ca7893606656f84b85f', 'request_id': 'req-6cb00c4e-6488-4bf8-a10e-d163818f3b60'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:10.189418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] The token cache is being invalidate because project 9bff32c781834ca7893606656f84b85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:10.190707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:10.191747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6cb00c4e-6488-4bf8-a10e-d163818f3b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:10.195897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1207/2406] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:09 2022] DELETE /identity/v3/projects/9bff32c781834ca7893606656f84b85f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:10.201504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.201791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.202072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.229539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:10.235360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:10.346617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1200/2407] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:10.348363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.348647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.349496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.372152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:10.373550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:10.387009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1208/2408] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:00:10.391049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.403395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df53e6-403d-46c9-bbec-40e56e469cb3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.411101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.411745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.412022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.412292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.413084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:10.413394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.415017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.429463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1201/2409] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:10.433968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.443358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffc1a8-d124-4a86-b2ef-18fdb18f69f3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.448272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.448997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.449271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.449541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.450252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.452174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.482482 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1209/2410] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:10 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:10.483658 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.494547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51492c76-b932-467f-8764-d236cbea1ea2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.558457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.559244 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.559600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.559934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.560806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.562913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.591767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1202/2411] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:10 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:10.593286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.606302 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cf76-d372-40f8-81ac-a6c9345721b7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.611273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.612071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.612348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.612657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.616398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.618499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.631435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1210/2412] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:10.636424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.647046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3120bf-5e83-403c-8292-4643a3ad0ddc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.653747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d981f5-6c6e-4373-be5e-5a5b41986a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.654419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d981f5-6c6e-4373-be5e-5a5b41986a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.654697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d981f5-6c6e-4373-be5e-5a5b41986a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.655144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d981f5-6c6e-4373-be5e-5a5b41986a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.655901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d981f5-6c6e-4373-be5e-5a5b41986a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.657705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d981f5-6c6e-4373-be5e-5a5b41986a0d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.674042 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1203/2413] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:10.674703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.685112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb443f-0390-4b80-89d4-a3c969bbd329 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.690175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.691096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.691375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.691763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] PATH_INFO: `/v3/projects/d370655364a043639c3d4094519e925f/users/e13cf090191748a4bab44d69af881c11/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.709523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d370655364a043639c3d4094519e925f, user_id=e13cf090191748a4bab44d69af881c11, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.712184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:10.727766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1211/2414] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:10 2022] PUT /identity/v3/projects/d370655364a043639c3d4094519e925f/users/e13cf090191748a4bab44d69af881c11/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:10.739698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.739986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.740263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.769689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] MFA Rules not processed for user `e13cf090191748a4bab44d69af881c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:10.777167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:10.903531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1204/2415] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:10.908118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:10.982014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cfc23-b39d-4721-af3e-083344a26c56 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:10.988469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:10.989388 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:10.989753 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:10.990338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:10.991301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:10.995800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.040950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1212/2416] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:10 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:11.044227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:11.060358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab8c00-a4d7-4a22-a947-a7bbb4666111 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:11.168017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:11.169143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.169642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.170122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.171029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:11.173471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.213735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1205/2417] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:11 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:11.217552 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:11.228819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753e07-ba67-4836-9dff-c20e0e2c6a3b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:11.233290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:11.233980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.234387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.234679 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.235420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:11.237208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.255405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1213/2418] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:11.256696 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:11.270280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aa9ae-2f04-4826-89a3-7624452ae5cb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:11.277993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:11.277993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.277993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.277993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] PATH_INFO: `/v3/projects/f0164c7214944145b6da5cdcc3f3ba46/users/29ba6c284e964e10926fef7562450787/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.306128 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0164c7214944145b6da5cdcc3f3ba46, user_id=29ba6c284e964e10926fef7562450787, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:11.323637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.347942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1206/2419] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:11 2022] PUT /identity/v3/projects/f0164c7214944145b6da5cdcc3f3ba46/users/29ba6c284e964e10926fef7562450787/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:11.352444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:11.376454 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6fcd-d6ef-4acc-aa71-263bb1a4f318 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:11.511580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c62d-6c06-4600-a668-414881c337ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:11.512575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c62d-6c06-4600-a668-414881c337ee admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.513273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c62d-6c06-4600-a668-414881c337ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.513772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c62d-6c06-4600-a668-414881c337ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.514843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c62d-6c06-4600-a668-414881c337ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:11.516593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c62d-6c06-4600-a668-414881c337ee admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.540373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1214/2420] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:11.544860 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:11.558583 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee779d-20f0-42fd-a3cb-f528c00f7159 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:11.563449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:11.565755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.565755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.565755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] PATH_INFO: `/v3/projects/f0164c7214944145b6da5cdcc3f3ba46/users/29ba6c284e964e10926fef7562450787/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.569099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0164c7214944145b6da5cdcc3f3ba46, user_id=29ba6c284e964e10926fef7562450787, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:11.572527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.588771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1207/2421] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:11 2022] PUT /identity/v3/projects/f0164c7214944145b6da5cdcc3f3ba46/users/29ba6c284e964e10926fef7562450787/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:11.595876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.596529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.598476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.663289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] MFA Rules not processed for user `29ba6c284e964e10926fef7562450787`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:11.664888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:11.801583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1215/2422] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:11.810122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:11.812100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:11.885077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85381-4cf8-449b-aafe-3a9da3f20445 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:11.889579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:11.890554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:11.890942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:11.891543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:11.909238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:11.910853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:11.939531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1208/2423] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:12.034087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:12.046164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358fec-4123-460b-8565-cabf5cb74b7f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:12.051812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:12.053832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:12.055094 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:12.055545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:12.159430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:12.160977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:12.171113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1216/2424] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:00:17.645419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:17.646857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:17.766924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a711fc-a7c3-4a04-90e8-9fe82439036a service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:17.774088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:17.775587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:17.775870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:17.776143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] PATH_INFO: `/v3/users/f755cdacf8054a9e916ec75f1dedc105` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:17.777402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f755cdacf8054a9e916ec75f1dedc105)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:17.779458 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:17.867164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f755cdacf8054a9e916ec75f1dedc105'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:17.891365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f755cdacf8054a9e916ec75f1dedc105'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:17.893243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f755cdacf8054a9e916ec75f1dedc105'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:17.898531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:17.913306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f755cdacf8054a9e916ec75f1dedc105'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:17.914818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefafa69-cf46-47e9-bbdd-e8c773a35e73 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:17.925637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:17.927078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:17.927583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:17.928082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] PATH_INFO: `/v3/users/e13cf090191748a4bab44d69af881c11` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:17.929672 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-7b1a82f9-de5b-4bfc-9bf8-c4d7fa5ee51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f755cdacf8054a9e916ec75f1dedc105'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:17.930627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13cf090191748a4bab44d69af881c11)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:17.933751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:17.937318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1209/2425] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:17 2022] DELETE /identity/v3/users/f755cdacf8054a9e916ec75f1dedc105 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:18.031213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13cf090191748a4bab44d69af881c11'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.032045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13cf090191748a4bab44d69af881c11'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.040281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13cf090191748a4bab44d69af881c11'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.059402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13cf090191748a4bab44d69af881c11'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.066387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13cf090191748a4bab44d69af881c11'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.087274 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1217/2426] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:17 2022] DELETE /identity/v3/users/e13cf090191748a4bab44d69af881c11 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:18.092859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.093258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.093758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.146556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:18.148091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.214039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.215923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.252840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1210/2427] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:00:18.265119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.267111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.295417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980b0a-a271-46c3-a595-c6def8f00825 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.300693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.301666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.301996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.302266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] PATH_INFO: `/v3/projects/9cdfe1c1946840c19d3d559fb81e34b5` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.305541 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdfe1c1946840c19d3d559fb81e34b5)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.308008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.341504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302aad3-e324-4825-9b9a-aaf3f94cca4a None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.346348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1006-1034-4e92-8767-ae51384482f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.347112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1006-1034-4e92-8767-ae51384482f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.347457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1006-1034-4e92-8767-ae51384482f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.347870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1006-1034-4e92-8767-ae51384482f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.359303 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1006-1034-4e92-8767-ae51384482f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.360948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1006-1034-4e92-8767-ae51384482f0 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.364620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdfe1c1946840c19d3d559fb81e34b5', 'request_id': 'req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.374601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdfe1c1946840c19d3d559fb81e34b5', 'request_id': 'req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.381102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdfe1c1946840c19d3d559fb81e34b5', 'request_id': 'req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.384834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1211/2428] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:18.404950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] The token cache is being invalidate because project 9cdfe1c1946840c19d3d559fb81e34b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:18.405587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.406837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-72c0df7f-7d54-4ce4-9c28-e5d54c1ca13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.410822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1218/2429] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:18 2022] DELETE /identity/v3/projects/9cdfe1c1946840c19d3d559fb81e34b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:18.417005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.417659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.418227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.438966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:18.440304 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.525426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1212/2430] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:18.527255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.527542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.527842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.552366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:18.554156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.564989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1219/2431] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:18.570220 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.594029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbcb8-58bd-4b74-aefb-6abaebceee40 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.603143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.603988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.604271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.604543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.605510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:18.606185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.607840 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.623222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1213/2432] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:18.628569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.638527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d141-59df-496e-9a2a-ef9b8dbbcb7f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.645099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.646173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.646661 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.647353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.648187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.650380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.691635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1220/2433] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:18 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:00:18.693351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.703722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.708755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.710129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1b146-86cd-433c-a86e-516945d3cffc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.782799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.783503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.783744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.784014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.784775 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.786782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.813040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d1b66-c9db-4327-8b0d-c610d8f3586f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.818135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1214/2434] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:18 2022] POST /identity/v3/users => generated 279 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:18.818588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.819465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.819740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.820009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] PATH_INFO: `/v3/projects/d370655364a043639c3d4094519e925f` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.820322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.821279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d370655364a043639c3d4094519e925f)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.823246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.834089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c98f-7997-48ad-8f64-33135bc7b3ea admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.839597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.840277 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.840618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.840930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.841713 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.843333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:18.855619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1215/2435] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:18.860171 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.871821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3e7e-f85d-4232-bc6a-0b12ae60653a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:18.897662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd370655364a043639c3d4094519e925f', 'request_id': 'req-4538e29d-411c-408f-83d2-dfcd1a989ef1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.910132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd370655364a043639c3d4094519e925f', 'request_id': 'req-4538e29d-411c-408f-83d2-dfcd1a989ef1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.919145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd370655364a043639c3d4094519e925f', 'request_id': 'req-4538e29d-411c-408f-83d2-dfcd1a989ef1'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.943835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] The token cache is being invalidate because project d370655364a043639c3d4094519e925f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:18.944111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.944740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:18.950452 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1221/2436] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:18 2022] DELETE /identity/v3/projects/d370655364a043639c3d4094519e925f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:18.952707 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:18.954581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:18.978172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:18.979185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:18.979486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:18.979782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:18.980534 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:18.987243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.006099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1216/2437] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:19.015225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.018098 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:19.039753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50f85-42d5-4406-97b4-68c81863223e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.045581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7dcf7-e1b2-4be0-b2ca-4eab382d9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.046990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7dcf7-e1b2-4be0-b2ca-4eab382d9cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.047280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7dcf7-e1b2-4be0-b2ca-4eab382d9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.047560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7dcf7-e1b2-4be0-b2ca-4eab382d9cf4 admin admin] PATH_INFO: `/v3/projects/9c47f97390764fb78916b31cbe8a6dff/users/386f22968e854e6b8e9a57dd28b105c1/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.068023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7dcf7-e1b2-4be0-b2ca-4eab382d9cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c47f97390764fb78916b31cbe8a6dff, user_id=386f22968e854e6b8e9a57dd28b105c1, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.071055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7dcf7-e1b2-4be0-b2ca-4eab382d9cf4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.092761 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1217/2438] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:19 2022] PUT /identity/v3/projects/9c47f97390764fb78916b31cbe8a6dff/users/386f22968e854e6b8e9a57dd28b105c1/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:19.092932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e29d-411c-408f-83d2-dfcd1a989ef1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.103199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.103492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.103767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.138833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] MFA Rules not processed for user `386f22968e854e6b8e9a57dd28b105c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:19.140415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:19.168071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.169672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.170140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.170606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] PATH_INFO: `/v3/users/29ba6c284e964e10926fef7562450787` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.172152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ba6c284e964e10926fef7562450787)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.174402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.237353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ba6c284e964e10926fef7562450787'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.242727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ba6c284e964e10926fef7562450787'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.250858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1218/2439] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:19.255236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.258406 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ba6c284e964e10926fef7562450787'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.270714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07539c6-9d07-4848-b5d7-9d937d80e571 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.274003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.274871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.275175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.275548 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.276246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ba6c284e964e10926fef7562450787'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.276657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.278859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.297211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ba6c284e964e10926fef7562450787'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.310886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1219/2441] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:19 2022] POST /identity/v3/projects => generated 355 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:00:19.318003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.320067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:19.323021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1222/2441] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:18 2022] DELETE /identity/v3/users/29ba6c284e964e10926fef7562450787 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:19.401913 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a851-95a9-4343-afa7-1c565b3f9bc8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.478798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.479486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.479763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.480034 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.480929 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.482894 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.527976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1220/2442] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:19 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:19.532517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.544076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eee37-9cd3-4e89-9d6d-cfd50f82d3e0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.552217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.553464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.553968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.554388 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.555151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.557651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.573665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1223/2443] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:19.574299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.592996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d13ca7-ce00-47c6-a4f9-1faaba0f6579 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.601824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.602872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.603159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.603435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] PATH_INFO: `/v3/projects/d17eebc335b349feb90cf8cf81449226/users/7c67b5dfb56c424fb0261d0974dd37bf/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.635251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17eebc335b349feb90cf8cf81449226, user_id=7c67b5dfb56c424fb0261d0974dd37bf, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.638657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.660872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1221/2444] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:19 2022] PUT /identity/v3/projects/d17eebc335b349feb90cf8cf81449226/users/7c67b5dfb56c424fb0261d0974dd37bf/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:19.667349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.681881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.684571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac99d-b0c6-42da-b39d-9bc517177eea admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.686715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:19.764776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eace2-e865-4877-a73c-d4a40889f1ea admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.764776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.765579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.765579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.765739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] PATH_INFO: `/v3/projects/f0164c7214944145b6da5cdcc3f3ba46` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.766839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0164c7214944145b6da5cdcc3f3ba46)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.768849 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.782226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.784308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.784308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.784840 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.788008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.789581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.818751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1224/2445] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:19.820050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:19.831945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b0e7-557c-444c-9219-000f9bee7fe7 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:19.837206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba903369-51c0-450e-bffc-5537033ad65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:19.838096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba903369-51c0-450e-bffc-5537033ad65c admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.838391 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba903369-51c0-450e-bffc-5537033ad65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.838655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba903369-51c0-450e-bffc-5537033ad65c admin admin] PATH_INFO: `/v3/projects/d17eebc335b349feb90cf8cf81449226/users/7c67b5dfb56c424fb0261d0974dd37bf/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.840794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba903369-51c0-450e-bffc-5537033ad65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17eebc335b349feb90cf8cf81449226, user_id=7c67b5dfb56c424fb0261d0974dd37bf, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:19.843580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba903369-51c0-450e-bffc-5537033ad65c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:19.852934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0164c7214944145b6da5cdcc3f3ba46', 'request_id': 'req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.856112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1225/2446] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:19 2022] PUT /identity/v3/projects/d17eebc335b349feb90cf8cf81449226/users/7c67b5dfb56c424fb0261d0974dd37bf/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:19.866716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0164c7214944145b6da5cdcc3f3ba46', 'request_id': 'req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.870288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.870632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.870884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.875805 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0164c7214944145b6da5cdcc3f3ba46', 'request_id': 'req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.895738 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] The token cache is being invalidate because project f0164c7214944145b6da5cdcc3f3ba46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:19.896188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.896905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-246677a0-1c94-4d3e-8ea9-e31f0cb9f917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:19.898745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1222/2447] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:19 2022] DELETE /identity/v3/projects/f0164c7214944145b6da5cdcc3f3ba46 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:19.905003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4b987-858e-48fc-b920-ddad0b83c542 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:19.905366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4b987-858e-48fc-b920-ddad0b83c542 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:19.905645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4b987-858e-48fc-b920-ddad0b83c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:19.927837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] MFA Rules not processed for user `7c67b5dfb56c424fb0261d0974dd37bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:19.929711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:19.930035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1af4b987-858e-48fc-b920-ddad0b83c542 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:19.931438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1af4b987-858e-48fc-b920-ddad0b83c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:20.023400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1223/2448] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:20.028102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1226/2449] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:20.034335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.035163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.035991 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.038751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.042312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:20.056226 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:20.057442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:20.096375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1224/2450] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:20.101201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.115886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e6ff-5b1e-4f15-81a8-56db2808f7ea None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.121522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf17dc-5808-435b-aa6a-c0ee2bcbd10e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.127062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.127739 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.128014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.128289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.129102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:20.129406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.131018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.135598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.136291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.136569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.136857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.153008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.157075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.158133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1225/2451] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 03 03:00:20.163383 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.172021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1227/2452] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:20 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:00:20.178060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cfa5d-d428-4acc-93b6-6a2ae60700ea admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.184281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.185050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.187712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.187712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.187712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.188529 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.236774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1226/2453] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:20 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:20.238125 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.254845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2281ebf-3aa7-4a51-8b4b-4ae010ec8ac4 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.306589 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.346645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.347615 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.348102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.348599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.349553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.352219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.396181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1228/2454] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:20 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:20.402376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.418467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a57e07-433d-4fff-955d-2cf17429ad7f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.424799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.424799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.424799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.424799 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.427162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:20.427582 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a0cc-3da5-41f5-b142-c2522f02eb63 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.440140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.441618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.441892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.442216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.443086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.446605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.462881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1229/2455] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:20.464192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.477325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db12b8-be28-4152-90db-a8899581f43b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.483964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.485597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.486278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.486433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.487518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.489570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.518747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1230/2456] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:20.528694 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.553828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.558379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273a693-12e7-444d-b229-b90b51504230 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.560887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206bf0a-99e0-4fda-99ee-25a44fcadea3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.578649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1227/2457] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:20 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:20.601980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.603755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.604261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.604779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] PATH_INFO: `/v3/projects/838873f1f5ec407c9e7a994e9b6ab3cd/users/6d8ec23954a84cdd80a41cb3f924bfe1/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.639307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838873f1f5ec407c9e7a994e9b6ab3cd, user_id=6d8ec23954a84cdd80a41cb3f924bfe1, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.642791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.665963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1231/2458] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:20 2022] PUT /identity/v3/projects/838873f1f5ec407c9e7a994e9b6ab3cd/users/6d8ec23954a84cdd80a41cb3f924bfe1/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:20.681822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268883-6bba-416a-8a28-20a15e0c4297 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.682619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268883-6bba-416a-8a28-20a15e0c4297 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.683124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268883-6bba-416a-8a28-20a15e0c4297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.717416 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-e0268883-6bba-416a-8a28-20a15e0c4297 None None] MFA Rules not processed for user `6d8ec23954a84cdd80a41cb3f924bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:20.718768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e0268883-6bba-416a-8a28-20a15e0c4297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:20.840482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1228/2459] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:20.854733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:20.856620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:20.963060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4124a-b3b0-4031-82b7-dd23afcb4dc5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:20.966728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df091e-9277-438c-beb4-5584ed7743cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:20.967375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df091e-9277-438c-beb4-5584ed7743cf service glance] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:20.967666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df091e-9277-438c-beb4-5584ed7743cf service glance] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:20.967938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df091e-9277-438c-beb4-5584ed7743cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:20.976572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df091e-9277-438c-beb4-5584ed7743cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:20.978057 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df091e-9277-438c-beb4-5584ed7743cf service glance] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:20.986882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1232/2460] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:25.087950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e082-fc53-4709-ae4d-f51a935c8a41 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:25.088466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e082-fc53-4709-ae4d-f51a935c8a41 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:25.088602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e082-fc53-4709-ae4d-f51a935c8a41 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:25.090660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1229/2461] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 03:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 03:00:25.096480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21860-8ca0-46d1-8569-95d5cb31cdaa None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:25.097092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21860-8ca0-46d1-8569-95d5cb31cdaa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:25.097092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21860-8ca0-46d1-8569-95d5cb31cdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:25.148424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9db21860-8ca0-46d1-8569-95d5cb31cdaa None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:25.149675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9db21860-8ca0-46d1-8569-95d5cb31cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:25.233189 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1233/2462] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 03:00:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:25.245062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e082-fc53-4709-ae4d-f51a935c8a41 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:25.257305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e082-fc53-4709-ae4d-f51a935c8a41 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:25.261530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e5aa2-2f6e-471e-bc48-24390205ce51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:25.262166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e5aa2-2f6e-471e-bc48-24390205ce51 service glance] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:25.262439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e5aa2-2f6e-471e-bc48-24390205ce51 service glance] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:25.262705 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e5aa2-2f6e-471e-bc48-24390205ce51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:25.272489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e5aa2-2f6e-471e-bc48-24390205ce51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:25.273968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e5aa2-2f6e-471e-bc48-24390205ce51 service glance] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:25.286541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1230/2463] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:25.357680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb67d6-1948-4566-96bc-f9d228fc6a53 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:25.357921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb67d6-1948-4566-96bc-f9d228fc6a53 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:25.358221 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb67d6-1948-4566-96bc-f9d228fc6a53 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:25.360060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1234/2464] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 03:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 03:00:25.364988 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82f15-c9e7-4a8e-b4cd-54dca7d02d84 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:25.365310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82f15-c9e7-4a8e-b4cd-54dca7d02d84 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:25.365594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82f15-c9e7-4a8e-b4cd-54dca7d02d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:25.386693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9cc82f15-c9e7-4a8e-b4cd-54dca7d02d84 None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:25.387903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9cc82f15-c9e7-4a8e-b4cd-54dca7d02d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:25.444160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1231/2465] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 03:00:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:25.456180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb67d6-1948-4566-96bc-f9d228fc6a53 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:25.458439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-87cb67d6-1948-4566-96bc-f9d228fc6a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:25.472966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb67d6-1948-4566-96bc-f9d228fc6a53 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:25.477250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:25.477932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:25.478161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:25.478417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:25.485894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:25.487404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:25.498229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1235/2466] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:27.796919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:27.797444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:27.797444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:27.848774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:27.850401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:27.936454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1232/2467] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:27.949035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:27.950578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:28.042161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd257b-50ca-4399-bafc-217be6c730f9 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:28.051066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0bd0-0d3e-4e14-82a6-f26356a7af07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:28.051835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0bd0-0d3e-4e14-82a6-f26356a7af07 service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:28.052153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0bd0-0d3e-4e14-82a6-f26356a7af07 service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:28.052424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0bd0-0d3e-4e14-82a6-f26356a7af07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:28.062350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0bd0-0d3e-4e14-82a6-f26356a7af07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:28.063976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0bd0-0d3e-4e14-82a6-f26356a7af07 service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:28.072325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1236/2468] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:00:35.686519 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:35.688051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:35.767492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ec610-ebe4-4dbb-8d3a-69b5251182da None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:35.773346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:35.774328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:35.774602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:35.774875 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] PATH_INFO: `/v3/users/386f22968e854e6b8e9a57dd28b105c1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:35.776108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] RBAC: Authorizing `identity:delete_user(user_id=386f22968e854e6b8e9a57dd28b105c1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:35.778193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:35.826926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386f22968e854e6b8e9a57dd28b105c1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:35.835642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386f22968e854e6b8e9a57dd28b105c1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:35.836270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386f22968e854e6b8e9a57dd28b105c1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:35.843671 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386f22968e854e6b8e9a57dd28b105c1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:35.856430 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386f22968e854e6b8e9a57dd28b105c1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:35.866160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1233/2469] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:35 2022] DELETE /identity/v3/users/386f22968e854e6b8e9a57dd28b105c1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:35.871190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:35.871710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:35.871802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:35.889810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:35.890991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:35.954513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1237/2470] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:35.965466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:35.967709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:36.034999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f84d7-2c9c-4612-9ce9-cf0f4026faba admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:36.039189 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:36.039842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:36.040119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:36.040397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:36.057174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:36.058731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:36.074432 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1234/2471] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:36.418372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:36.419970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:36.432763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaa2ff-a946-4d5e-b12d-a075f75b6557 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:36.437695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:36.438563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:36.438835 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:36.439105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] PATH_INFO: `/v3/projects/9c47f97390764fb78916b31cbe8a6dff` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:36.440340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c47f97390764fb78916b31cbe8a6dff)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:36.443818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:36.497427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c47f97390764fb78916b31cbe8a6dff', 'request_id': 'req-2b98b367-7729-4b1a-b95b-c25290895734'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.505106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c47f97390764fb78916b31cbe8a6dff', 'request_id': 'req-2b98b367-7729-4b1a-b95b-c25290895734'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.511416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c47f97390764fb78916b31cbe8a6dff', 'request_id': 'req-2b98b367-7729-4b1a-b95b-c25290895734'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.525715 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] The token cache is being invalidate because project 9c47f97390764fb78916b31cbe8a6dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:36.526182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.526988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.529226 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1238/2472] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:36 2022] DELETE /identity/v3/projects/9c47f97390764fb78916b31cbe8a6dff => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:36.533354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:36.544649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813926-b422-4167-b087-e77fc4a9d0f1 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:36.613242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:36.614047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:36.614339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:36.614635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] PATH_INFO: `/v3/users/7c67b5dfb56c424fb0261d0974dd37bf` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:36.615908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c67b5dfb56c424fb0261d0974dd37bf)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:36.618079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:36.668880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c67b5dfb56c424fb0261d0974dd37bf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.676858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c67b5dfb56c424fb0261d0974dd37bf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.677460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c67b5dfb56c424fb0261d0974dd37bf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.684211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c67b5dfb56c424fb0261d0974dd37bf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.696112 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6e604337-035c-4924-9863-628675ac9c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c67b5dfb56c424fb0261d0974dd37bf'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:36.702870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1235/2473] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:36 2022] DELETE /identity/v3/users/7c67b5dfb56c424fb0261d0974dd37bf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:36.977160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:36.979151 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:36.993066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b367-7729-4b1a-b95b-c25290895734 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.051040 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.051892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.052168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.052433 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] PATH_INFO: `/v3/projects/d17eebc335b349feb90cf8cf81449226` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.053828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17eebc335b349feb90cf8cf81449226)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.055736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.103792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17eebc335b349feb90cf8cf81449226', 'request_id': 'req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:37.110238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17eebc335b349feb90cf8cf81449226', 'request_id': 'req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:37.116495 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17eebc335b349feb90cf8cf81449226', 'request_id': 'req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:37.130637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] The token cache is being invalidate because project d17eebc335b349feb90cf8cf81449226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:37.130919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:37.131568 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1197b3b9-dbab-4bc4-b2fa-c618cf027f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:37.133196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1239/2474] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:36 2022] DELETE /identity/v3/projects/d17eebc335b349feb90cf8cf81449226 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:37.139175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.139460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.139724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.158560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:37.159678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:37.227369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1236/2475] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:37.235587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.235851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.236258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.255742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:37.256976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:37.265418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1240/2476] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:37.270983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.282219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c74b6-692c-44ba-96bf-5d32e00c2cb3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.288265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.288961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.289238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.289506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.290229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:37.290530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.292149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.304209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1237/2477] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:37.308807 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.319118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ddf9c-7c26-41ca-9ec5-44eb93634f84 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.325074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.325731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.326002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.326254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.326977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.328906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.358012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1241/2478] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:37.362124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.372049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f69b6-2b9e-414b-ac9c-9fe9d37fb407 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.435498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.436185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.436466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.436766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.437491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.439546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.469129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1238/2479] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:37.473340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.484666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453922e7-6bb8-4dd2-b579-d83e674800f5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.490006 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.490671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.490985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.491264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.492012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.493711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.504844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1242/2480] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:37.508627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.521356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd31d8-24bb-4855-b11a-c335a02b300c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.526669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c2a07-7645-4a9e-9c09-d5296a8608e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.527322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2a07-7645-4a9e-9c09-d5296a8608e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.527599 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2a07-7645-4a9e-9c09-d5296a8608e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.527870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2a07-7645-4a9e-9c09-d5296a8608e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.528606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c2a07-7645-4a9e-9c09-d5296a8608e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.530266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c2a07-7645-4a9e-9c09-d5296a8608e0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.540056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1239/2481] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:37.545544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.555624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4684f01-f427-4e76-be25-7537c8b4311a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.560394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.561317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.561597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.561892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] PATH_INFO: `/v3/projects/ffe1346a971e402583d3717cb74cfa95/users/97c4d69b62d84c29990192ffa5d21728/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.577545 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe1346a971e402583d3717cb74cfa95, user_id=97c4d69b62d84c29990192ffa5d21728, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.580593 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.594102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1243/2482] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:37 2022] PUT /identity/v3/projects/ffe1346a971e402583d3717cb74cfa95/users/97c4d69b62d84c29990192ffa5d21728/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:37.604952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.605369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.605623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.635990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] MFA Rules not processed for user `97c4d69b62d84c29990192ffa5d21728`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:37.637381 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:37.703795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1240/2483] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:37.708432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.771825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947690-58e7-4f3b-af83-8513280e34f5 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.777622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.778385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.778725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.779062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.779776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.781800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.808602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1244/2484] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:37.812834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.823785 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f272642-1ab3-4d76-baf9-4fc884ddd8a9 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.883177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.883889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.884170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.884446 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.885199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.887152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.908199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1241/2485] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:37 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:00:37.912308 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.922784 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0751c6-0dd5-4331-9b97-e9a8c4a79338 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.928230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.928927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.929213 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.929488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.930245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.931964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.943096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1245/2486] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:37.947267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:37.957638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634c730-366a-4885-8ce5-f27212990a52 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:37.962994 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:37.963968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:37.964245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:37.964510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] PATH_INFO: `/v3/projects/97faafb9104749c18504a3cb696e90d0/users/86e8fcd724c4472c86c9c67abdf98368/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:37.979538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97faafb9104749c18504a3cb696e90d0, user_id=86e8fcd724c4472c86c9c67abdf98368, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:37.982217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:37.997158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1242/2487] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:37 2022] PUT /identity/v3/projects/97faafb9104749c18504a3cb696e90d0/users/86e8fcd724c4472c86c9c67abdf98368/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:38.001078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:38.011012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225f7ff-b1f3-4554-a337-8cb586655e5c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:38.068880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0633-2847-472e-8e52-32bdfa360466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:38.069560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0633-2847-472e-8e52-32bdfa360466 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:38.069841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0633-2847-472e-8e52-32bdfa360466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:38.070119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0633-2847-472e-8e52-32bdfa360466 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:38.070864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0633-2847-472e-8e52-32bdfa360466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:38.072476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0633-2847-472e-8e52-32bdfa360466 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:38.082570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1246/2488] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:38.087031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:38.097829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c92d-b4e8-46b8-a481-5dab0029fd62 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:38.103706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:38.104584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:38.104891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:38.105164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] PATH_INFO: `/v3/projects/97faafb9104749c18504a3cb696e90d0/users/86e8fcd724c4472c86c9c67abdf98368/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:38.107444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97faafb9104749c18504a3cb696e90d0, user_id=86e8fcd724c4472c86c9c67abdf98368, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:38.110140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:38.121801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1243/2489] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:38 2022] PUT /identity/v3/projects/97faafb9104749c18504a3cb696e90d0/users/86e8fcd724c4472c86c9c67abdf98368/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:38.132969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:38.133256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:38.133525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:38.159465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] MFA Rules not processed for user `86e8fcd724c4472c86c9c67abdf98368`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:38.160656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:38.230357 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1247/2490] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:38.241023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:38.243091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:38.305058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60258-c276-479f-b544-c964a7159d3a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:38.309767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:38.310543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:38.310907 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:38.311174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:38.325201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:38.326631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:38.336364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1244/2491] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:38.388766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:38.390272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:38.402891 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb4fd-a208-41e8-82af-9cbad4bdc29b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:38.407569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b9969-2038-4966-a668-6811fa02a84f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:38.408217 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b9969-2038-4966-a668-6811fa02a84f service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:38.408493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b9969-2038-4966-a668-6811fa02a84f service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:38.408746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b9969-2038-4966-a668-6811fa02a84f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:38.468640 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b9969-2038-4966-a668-6811fa02a84f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:38.470124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b9969-2038-4966-a668-6811fa02a84f service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:38.479384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1248/2492] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:41.707883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:41.772105 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45337ae0-f153-4291-8685-db5601415bba service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:41.776985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:41.777871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:41.778143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:41.778416 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] PATH_INFO: `/v3/users/97c4d69b62d84c29990192ffa5d21728` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:41.779607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c4d69b62d84c29990192ffa5d21728)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:41.781546 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:41.831014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c4d69b62d84c29990192ffa5d21728'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:41.839619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c4d69b62d84c29990192ffa5d21728'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:41.840225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c4d69b62d84c29990192ffa5d21728'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:41.846733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c4d69b62d84c29990192ffa5d21728'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:41.858787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c4d69b62d84c29990192ffa5d21728'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:41.864628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1245/2493] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:41 2022] DELETE /identity/v3/users/97c4d69b62d84c29990192ffa5d21728 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:41.869307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:41.869823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:41.869823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:41.887330 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:41.888522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:41.949089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1249/2494] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:41.958689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:41.960240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:42.015248 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87266df-0ba2-4cc0-a861-f078fdaaefa9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:42.019045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:42.019684 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:42.019961 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:42.020229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:42.029139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:42.030577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:42.040169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1246/2495] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:42.312193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:42.313677 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:42.325597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a01f-4ae3-48f5-b600-6a34b4da1b3e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:42.330475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:42.331335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:42.331608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:42.331869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] PATH_INFO: `/v3/projects/ffe1346a971e402583d3717cb74cfa95` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:42.333143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe1346a971e402583d3717cb74cfa95)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:42.335066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:42.387211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe1346a971e402583d3717cb74cfa95', 'request_id': 'req-008325a9-88c7-4e8e-ab5b-94e026757a40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.393535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe1346a971e402583d3717cb74cfa95', 'request_id': 'req-008325a9-88c7-4e8e-ab5b-94e026757a40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.398869 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe1346a971e402583d3717cb74cfa95', 'request_id': 'req-008325a9-88c7-4e8e-ab5b-94e026757a40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.412524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] The token cache is being invalidate because project ffe1346a971e402583d3717cb74cfa95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:42.412805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.413514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.415141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1250/2496] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:42 2022] DELETE /identity/v3/projects/ffe1346a971e402583d3717cb74cfa95 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:42.419282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:42.429116 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae9fe-6cd7-4ba8-bde4-3263ba6a5041 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:42.490569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:42.491723 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:42.492108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:42.492532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] PATH_INFO: `/v3/users/86e8fcd724c4472c86c9c67abdf98368` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:42.494586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e8fcd724c4472c86c9c67abdf98368)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:42.496895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:42.545233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e8fcd724c4472c86c9c67abdf98368'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.553697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e8fcd724c4472c86c9c67abdf98368'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.554397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e8fcd724c4472c86c9c67abdf98368'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.562197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e8fcd724c4472c86c9c67abdf98368'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.573893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ccde4999-23ba-477b-b806-96dbd83ab958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e8fcd724c4472c86c9c67abdf98368'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.579813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1247/2497] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:42 2022] DELETE /identity/v3/users/86e8fcd724c4472c86c9c67abdf98368 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:42.845544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:42.847254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:42.861105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008325a9-88c7-4e8e-ab5b-94e026757a40 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:42.918385 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:42.919271 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:42.919547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:42.919819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] PATH_INFO: `/v3/projects/97faafb9104749c18504a3cb696e90d0` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:42.921083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97faafb9104749c18504a3cb696e90d0)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:42.923039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:42.973652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97faafb9104749c18504a3cb696e90d0', 'request_id': 'req-9d040072-3eac-4366-9403-12279580b9b7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.980468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97faafb9104749c18504a3cb696e90d0', 'request_id': 'req-9d040072-3eac-4366-9403-12279580b9b7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:42.987072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97faafb9104749c18504a3cb696e90d0', 'request_id': 'req-9d040072-3eac-4366-9403-12279580b9b7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:43.001783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] The token cache is being invalidate because project 97faafb9104749c18504a3cb696e90d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:43.002049 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:43.002703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9d040072-3eac-4366-9403-12279580b9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:43.004276 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1251/2498] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:42 2022] DELETE /identity/v3/projects/97faafb9104749c18504a3cb696e90d0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:43.010127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.010626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.010754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.029152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:43.030355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:43.091270 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1248/2499] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:00:43.099325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.099984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.100254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.118317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:43.119493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:43.127534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1252/2500] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:43.131779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.141353 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e5ec-02f6-43e3-8cd6-38f0ee7acd23 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.146082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.146737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.147009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.147285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.148029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:43.148361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.150030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.161714 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1249/2501] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:43.166318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.175436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab96c2-db88-4431-9c78-c6477cad041e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.180194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.180876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.181156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.181421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.182254 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.184266 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.211153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1253/2502] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:43.215448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.225869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba4d1-db13-46a6-aaf3-62224ea514a3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.289703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.290388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.290670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.290940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.291728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.293746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.324691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1250/2503] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:43.325915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.336581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c95ddd-5e8a-4d2d-b6a3-e9f75b39fc56 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.341698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.342362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.342639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.342911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.343653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.345366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.359766 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1254/2504] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:43.361085 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.371359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8a71-274c-4a0f-aaf1-b47750369705 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.376207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becfabb-f01d-4b8d-8b4d-c01d6f567e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.376904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becfabb-f01d-4b8d-8b4d-c01d6f567e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.377307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becfabb-f01d-4b8d-8b4d-c01d6f567e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.377585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becfabb-f01d-4b8d-8b4d-c01d6f567e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.378328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becfabb-f01d-4b8d-8b4d-c01d6f567e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.379944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becfabb-f01d-4b8d-8b4d-c01d6f567e77 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.390909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1251/2505] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:43.395239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.406800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a542c-1907-4d59-9bc0-eccd4e7602c6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.410260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.411131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.411404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.411670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] PATH_INFO: `/v3/projects/6f38c5554f6243cca8715a8f2d6274bf/users/e5f6166e029b474db4fa92cc7f406544/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.425900 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f38c5554f6243cca8715a8f2d6274bf, user_id=e5f6166e029b474db4fa92cc7f406544, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.428519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.445846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1255/2506] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:43 2022] PUT /identity/v3/projects/6f38c5554f6243cca8715a8f2d6274bf/users/e5f6166e029b474db4fa92cc7f406544/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:43.457522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.457828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.458195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.493344 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] MFA Rules not processed for user `e5f6166e029b474db4fa92cc7f406544`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:43.494576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:43.566309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1252/2507] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:43.571020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.634083 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472825b1-66b4-4c1d-8d33-678872161406 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.639737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.640400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.640676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.641005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.641710 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.643700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.674479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1256/2508] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:00:43.678825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.690023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ad94-3a4c-473f-b8c8-11efc4857087 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.747312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.747964 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.748241 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.748507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.749242 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.751154 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.772451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1253/2509] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:43 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:43.776607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.786828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65a7a-ed1a-4f3e-997b-b395d964cb55 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.792938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.793590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.793979 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.794108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.794860 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.796502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.807327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1257/2510] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:43.811346 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.821982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f920f-8952-4390-ab15-a37faf1785b3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.828032 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.828962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.829237 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.829513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] PATH_INFO: `/v3/projects/a59074454e60409fba1f0e9cf9cbef48/users/7c6686f877d84689b8170b94bd0cc857/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.844573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59074454e60409fba1f0e9cf9cbef48, user_id=7c6686f877d84689b8170b94bd0cc857, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.847249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.866301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1254/2511] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:43 2022] PUT /identity/v3/projects/a59074454e60409fba1f0e9cf9cbef48/users/7c6686f877d84689b8170b94bd0cc857/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:43.871588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.881721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74e1a-16f2-4629-b7ae-12daf0a54740 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.945214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6309d4-a4b7-4751-ae74-2def9a20fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.945864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6309d4-a4b7-4751-ae74-2def9a20fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.946147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6309d4-a4b7-4751-ae74-2def9a20fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.946420 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6309d4-a4b7-4751-ae74-2def9a20fa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.947159 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6309d4-a4b7-4751-ae74-2def9a20fa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.948772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6309d4-a4b7-4751-ae74-2def9a20fa6d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:43.960874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1258/2512] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:43.965774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:43.981597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af9fa3-3d33-45bb-bd91-e5d9de7f32fe admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:43.988925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:43.990197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:43.990465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:43.990726 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] PATH_INFO: `/v3/projects/a59074454e60409fba1f0e9cf9cbef48/users/7c6686f877d84689b8170b94bd0cc857/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:43.993823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59074454e60409fba1f0e9cf9cbef48, user_id=7c6686f877d84689b8170b94bd0cc857, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:43.996947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:44.007431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1255/2513] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:43 2022] PUT /identity/v3/projects/a59074454e60409fba1f0e9cf9cbef48/users/7c6686f877d84689b8170b94bd0cc857/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:44.018524 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b81de2-d6f0-4fb8-8b17-17bb7d4ef96a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:44.018916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b81de2-d6f0-4fb8-8b17-17bb7d4ef96a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:44.019277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b81de2-d6f0-4fb8-8b17-17bb7d4ef96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:44.047401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-20b81de2-d6f0-4fb8-8b17-17bb7d4ef96a None None] MFA Rules not processed for user `7c6686f877d84689b8170b94bd0cc857`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:44.048528 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-20b81de2-d6f0-4fb8-8b17-17bb7d4ef96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:44.119742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1259/2514] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:44.129826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:44.131647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:44.185779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab260-4f11-4eee-b7ee-481daa3f5ea5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:44.189670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:44.190310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:44.190591 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:44.190839 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:44.248254 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:44.249736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:44.258935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1256/2515] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:00:49.540327 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:49.540870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:49.540870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:49.559941 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:49.561311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:49.615930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1260/2516] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 3 03:00:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:49.629122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:49.630749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:49.702186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d73d-4ee1-49ac-831f-546a9d6b4748 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:49.708450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:49.709139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:49.709413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:49.709655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:49.719497 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:49.721167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:49.730176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1257/2517] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:00:50.548312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:50.549753 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:50.561672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffbb5e-a0e4-4685-a7c9-7ccd1ee94721 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:50.565555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec835e-4d2d-40ab-83d4-ce2fa0028471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:50.566212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec835e-4d2d-40ab-83d4-ce2fa0028471 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:50.566479 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec835e-4d2d-40ab-83d4-ce2fa0028471 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:50.566750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec835e-4d2d-40ab-83d4-ce2fa0028471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:50.576529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec835e-4d2d-40ab-83d4-ce2fa0028471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:50.578188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec835e-4d2d-40ab-83d4-ce2fa0028471 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:50.588098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1261/2518] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:53.465048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:53.466654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:53.532360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616419-7730-4128-90b2-99b26925c3cc service swift] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:53.537060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:53.537924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:53.538200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:53.538462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] PATH_INFO: `/v3/users/6d8ec23954a84cdd80a41cb3f924bfe1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:53.539685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8ec23954a84cdd80a41cb3f924bfe1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:53.541645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:53.594178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8ec23954a84cdd80a41cb3f924bfe1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:53.602611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8ec23954a84cdd80a41cb3f924bfe1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:53.603224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8ec23954a84cdd80a41cb3f924bfe1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:53.610111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8ec23954a84cdd80a41cb3f924bfe1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:53.621848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8ec23954a84cdd80a41cb3f924bfe1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:53.628080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1258/2519] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:53 2022] DELETE /identity/v3/users/6d8ec23954a84cdd80a41cb3f924bfe1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:53.632746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:53.633215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:53.633325 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:53.650658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:53.651842 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:53.710378 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1262/2520] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:53.720428 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:53.721981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:53.781351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662e4f-c4fc-4a2c-ac05-2650c5e666ab admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:53.785361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:53.785998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:53.786273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:53.786532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:53.796397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:53.797880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:53.807698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1259/2521] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:00:54.090395 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:54.091837 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:54.104367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8f1c5-b4ed-4b80-848b-b76f6f20412e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:54.110508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:54.111393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:54.111670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:54.111966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] PATH_INFO: `/v3/projects/838873f1f5ec407c9e7a994e9b6ab3cd` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:54.113473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838873f1f5ec407c9e7a994e9b6ab3cd)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:54.115915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:54.173719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838873f1f5ec407c9e7a994e9b6ab3cd', 'request_id': 'req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:54.180273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838873f1f5ec407c9e7a994e9b6ab3cd', 'request_id': 'req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:54.187206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838873f1f5ec407c9e7a994e9b6ab3cd', 'request_id': 'req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:54.201502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] The token cache is being invalidate because project 838873f1f5ec407c9e7a994e9b6ab3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:54.201793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:54.202400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-86a9d989-afcd-4ba5-b204-b56bdc75a6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:54.203959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1263/2522] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:54 2022] DELETE /identity/v3/projects/838873f1f5ec407c9e7a994e9b6ab3cd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:55.456180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:55.457827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:55.471363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598f53e-d42e-4df9-accf-124a4242c084 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:55.531727 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:55.532597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:55.532896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:55.533167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] PATH_INFO: `/v3/users/e5f6166e029b474db4fa92cc7f406544` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:55.534468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f6166e029b474db4fa92cc7f406544)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:55.536406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:55.586646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f6166e029b474db4fa92cc7f406544'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:55.594373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f6166e029b474db4fa92cc7f406544'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:55.595166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f6166e029b474db4fa92cc7f406544'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:55.602538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f6166e029b474db4fa92cc7f406544'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:55.615139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f6166e029b474db4fa92cc7f406544'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:55.622178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1260/2523] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:55 2022] DELETE /identity/v3/users/e5f6166e029b474db4fa92cc7f406544 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:55.627441 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:55.627934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:55.628030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:55.646620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:55.647834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:55.715128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1264/2524] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:55.725462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:55.727086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:55.796507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d2b9-71b8-4705-8387-72630eed20ec admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:55.801250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:55.801933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:55.802211 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:55.802482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:55.812423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:55.813901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:55.823467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1261/2525] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:00:56.083740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:56.085581 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:56.100283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e48b-3f32-49fc-bf35-5397863f2773 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:56.106574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:56.107478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.107705 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.107975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] PATH_INFO: `/v3/projects/6f38c5554f6243cca8715a8f2d6274bf` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.109307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f38c5554f6243cca8715a8f2d6274bf)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:56.111261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:56.158468 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f38c5554f6243cca8715a8f2d6274bf', 'request_id': 'req-46ba4620-4762-474b-b502-b2c0ef0a4cb8'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.165128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f38c5554f6243cca8715a8f2d6274bf', 'request_id': 'req-46ba4620-4762-474b-b502-b2c0ef0a4cb8'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.171396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f38c5554f6243cca8715a8f2d6274bf', 'request_id': 'req-46ba4620-4762-474b-b502-b2c0ef0a4cb8'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.186463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] The token cache is being invalidate because project 6f38c5554f6243cca8715a8f2d6274bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:56.186757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.187372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.189060 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1265/2526] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:56 2022] DELETE /identity/v3/projects/6f38c5554f6243cca8715a8f2d6274bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:00:56.193492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:56.203419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ab7f1-dc24-4d69-b4fa-2a47ac3f5daf service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:56.260060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:56.260865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.261147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.261413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] PATH_INFO: `/v3/users/7c6686f877d84689b8170b94bd0cc857` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.262657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6686f877d84689b8170b94bd0cc857)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:56.264686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:56.312028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6686f877d84689b8170b94bd0cc857'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.321228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6686f877d84689b8170b94bd0cc857'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.321842 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6686f877d84689b8170b94bd0cc857'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.328581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6686f877d84689b8170b94bd0cc857'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.339883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-4d2297a4-0c36-4019-a87c-66d5c1c85c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6686f877d84689b8170b94bd0cc857'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.345736 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1262/2527] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:00:56 2022] DELETE /identity/v3/users/7c6686f877d84689b8170b94bd0cc857 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:56.632343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:56.634161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:56.647659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba4620-4762-474b-b502-b2c0ef0a4cb8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:56.703146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:56.703989 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.704265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.704543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] PATH_INFO: `/v3/projects/a59074454e60409fba1f0e9cf9cbef48` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.705748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59074454e60409fba1f0e9cf9cbef48)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:56.707671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:56.757798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59074454e60409fba1f0e9cf9cbef48', 'request_id': 'req-e880aa67-4408-4f55-8631-3fe55c4e9086'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.763703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59074454e60409fba1f0e9cf9cbef48', 'request_id': 'req-e880aa67-4408-4f55-8631-3fe55c4e9086'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.769053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59074454e60409fba1f0e9cf9cbef48', 'request_id': 'req-e880aa67-4408-4f55-8631-3fe55c4e9086'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.782975 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] The token cache is being invalidate because project a59074454e60409fba1f0e9cf9cbef48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:00:56.783255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.783862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e880aa67-4408-4f55-8631-3fe55c4e9086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:00:56.785500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1266/2528] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:00:56 2022] DELETE /identity/v3/projects/a59074454e60409fba1f0e9cf9cbef48 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:56.792379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.792883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.792990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.811531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:56.812771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:56.882812 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1263/2529] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:56.892599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.893037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.893437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.916539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:56.917782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:56.927447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1267/2530] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:56.932674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:56.947811 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90810ac-0d16-413e-82a8-9e7656a51907 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:56.954477 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:56.955130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.955405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.955680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.956429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:00:56.956746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:56.958364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:56.969656 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1264/2531] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:00:56.974497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:56.984216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a129-0767-4fd2-afe1-42b46046c24f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:56.989723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:56.990372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:56.990683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:56.990958 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:56.991664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:56.993638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:57.023326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1268/2532] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:00:56 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:57.027698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:57.038834 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3dd50-3feb-4d17-9374-e7f11b3bdb2e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:57.097357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:57.098078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:57.098345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:57.098612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:57.099679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:57.101619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:57.122787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1265/2533] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:00:57 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:00:57.127111 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:57.137970 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e12c86-ac67-4f4d-a65e-5f341fff89dc admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:57.143603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:57.144255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:57.144557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:57.144854 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:57.145609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:57.147251 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:57.159035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1269/2534] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:00:57.163135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:57.173568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4a1a1-bb63-4410-9de7-ae0f4451835c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:57.179743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8171-d00a-4fcc-8f29-9289c3df5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:57.180397 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8171-d00a-4fcc-8f29-9289c3df5eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:57.180674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8171-d00a-4fcc-8f29-9289c3df5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:57.180976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8171-d00a-4fcc-8f29-9289c3df5eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:57.181716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8171-d00a-4fcc-8f29-9289c3df5eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:57.183312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8171-d00a-4fcc-8f29-9289c3df5eb1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:57.193538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1266/2535] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:00:57.197773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:57.208103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9cdd6-60d8-4260-a5d0-dc5a014cc077 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:57.214169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:57.215044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:57.215322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:57.215589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] PATH_INFO: `/v3/projects/c533385cc22e42e19cfc5b98bd08179d/users/de815c465fae443d8d3d517ff8a78ff4/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:57.230893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c533385cc22e42e19cfc5b98bd08179d, user_id=de815c465fae443d8d3d517ff8a78ff4, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:57.233675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:57.249488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1270/2536] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:00:57 2022] PUT /identity/v3/projects/c533385cc22e42e19cfc5b98bd08179d/users/de815c465fae443d8d3d517ff8a78ff4/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:00:57.261880 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295465a-a109-4ec9-80c1-997b08df3ecd None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:57.262163 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295465a-a109-4ec9-80c1-997b08df3ecd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:57.262439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295465a-a109-4ec9-80c1-997b08df3ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:57.290305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-9295465a-a109-4ec9-80c1-997b08df3ecd None None] MFA Rules not processed for user `de815c465fae443d8d3d517ff8a78ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:00:57.291422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9295465a-a109-4ec9-80c1-997b08df3ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:57.357461 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1267/2537] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:00:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:00:57.368218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:00:57.370186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:00:57.430314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf33bf-0582-44f1-a4b3-ea6fc0f64c96 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:00:57.435879 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:00:57.436523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:00:57.436819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:00:57.437086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:00:57.446317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:00:57.447764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:00:57.456602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1271/2538] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:00:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:14.467484 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a489a-f481-4a56-9c2d-ab1831a0db7e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:14.468022 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a489a-f481-4a56-9c2d-ab1831a0db7e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:14.468149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a489a-f481-4a56-9c2d-ab1831a0db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:14.485996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-2e3a489a-f481-4a56-9c2d-ab1831a0db7e None None] MFA Rules not processed for user `076a8d1b26864240a8007d2ac7080e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:14.487191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-2e3a489a-f481-4a56-9c2d-ab1831a0db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:14.541300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1268/2539] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:14.991393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:15.054020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e532e-5e37-4aa3-91ec-c8f98b9fa6e6 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:15.059340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:15.060215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:15.060488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:15.060976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] PATH_INFO: `/v3/users/de815c465fae443d8d3d517ff8a78ff4` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:15.062287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de815c465fae443d8d3d517ff8a78ff4)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:15.064268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:15.112646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de815c465fae443d8d3d517ff8a78ff4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.113333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de815c465fae443d8d3d517ff8a78ff4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.120583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de815c465fae443d8d3d517ff8a78ff4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.132780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de815c465fae443d8d3d517ff8a78ff4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.143284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de815c465fae443d8d3d517ff8a78ff4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.149824 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1272/2540] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:01:14 2022] DELETE /identity/v3/users/de815c465fae443d8d3d517ff8a78ff4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:15.154170 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:15.154456 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:15.155158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:15.177585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:15.178806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:15.245645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1269/2541] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:01:15.255461 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:15.256893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:15.314925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6fd1-b53e-4975-a598-02c357fc100d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:15.318728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50b5a8-e250-4405-92a3-942d3d19b7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:15.319381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b5a8-e250-4405-92a3-942d3d19b7dc service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:15.319656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b5a8-e250-4405-92a3-942d3d19b7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:15.319923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b5a8-e250-4405-92a3-942d3d19b7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:15.331247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50b5a8-e250-4405-92a3-942d3d19b7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:15.332691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50b5a8-e250-4405-92a3-942d3d19b7dc service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:15.342161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1273/2542] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:15.857962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:15.859483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:15.871597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca83bb5-aad8-41ce-9b5c-98da69c7ddcf None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:15.876600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:15.877523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:15.877795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:15.878087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] PATH_INFO: `/v3/projects/c533385cc22e42e19cfc5b98bd08179d` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:15.879405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c533385cc22e42e19cfc5b98bd08179d)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:15.882392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:15.928681 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c533385cc22e42e19cfc5b98bd08179d', 'request_id': 'req-5ae5427a-efac-4d8f-b64b-14eb55e729c8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.936621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c533385cc22e42e19cfc5b98bd08179d', 'request_id': 'req-5ae5427a-efac-4d8f-b64b-14eb55e729c8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.942871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c533385cc22e42e19cfc5b98bd08179d', 'request_id': 'req-5ae5427a-efac-4d8f-b64b-14eb55e729c8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.953481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] The token cache is being invalidate because project c533385cc22e42e19cfc5b98bd08179d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:01:15.953779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.954406 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5ae5427a-efac-4d8f-b64b-14eb55e729c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:15.955986 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1270/2543] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:01:15 2022] DELETE /identity/v3/projects/c533385cc22e42e19cfc5b98bd08179d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:15.961959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:15.962361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:15.962697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:15.982566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:15.983790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:16.048572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1274/2544] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:16.056312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.056635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.056943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.077123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:16.077959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:16.087499 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1271/2545] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:16.092052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.103153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7037e4-98e7-4bb6-a460-292c5f68b2cd None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.108665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.109400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.109691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.113683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.114024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:01:16.115026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.116872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.132920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1275/2546] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:01:16.134040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.143357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db02e8-6c37-4940-b7e2-f4165da982b6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.148327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.149025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.149301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.149564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.150279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.152166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.182790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1272/2547] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:01:16.187177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.197808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa29e-6977-40e2-9498-b9b7ed0e1d2c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.264760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.265522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.265794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.266052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.266791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.268809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.293377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1276/2548] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:01:16 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:01:16.294693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.305973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abcf0a-7fa7-4829-86e8-e1d7ee45dc77 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.310626 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.311294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.311570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.312032 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.312815 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.314459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.325377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1273/2549] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:16.329483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.339414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e21a6-2dd9-44ae-be14-b2f348f11476 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.344219 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb3c06-e2ca-45aa-a9d8-72da72530228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.344997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb3c06-e2ca-45aa-a9d8-72da72530228 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.345438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb3c06-e2ca-45aa-a9d8-72da72530228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.345749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb3c06-e2ca-45aa-a9d8-72da72530228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.346564 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb3c06-e2ca-45aa-a9d8-72da72530228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.348244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb3c06-e2ca-45aa-a9d8-72da72530228 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.360245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1277/2550] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:16.368921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.378891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1618df-f48c-43d4-8fb5-4635b39d0c7a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.383716 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.384588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.384893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.385162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] PATH_INFO: `/v3/projects/1e57f3c85d7e4d6d831173644f34732d/users/5e24b6b251044a11aafab2d423227495/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.400089 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e57f3c85d7e4d6d831173644f34732d, user_id=5e24b6b251044a11aafab2d423227495, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.402790 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.416103 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1274/2551] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:01:16 2022] PUT /identity/v3/projects/1e57f3c85d7e4d6d831173644f34732d/users/5e24b6b251044a11aafab2d423227495/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:01:16.426789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.427133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.427413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.454676 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] MFA Rules not processed for user `5e24b6b251044a11aafab2d423227495`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:16.455878 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:16.522340 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1278/2552] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:16.532659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:16.534692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:16.591263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd034d8-e11c-4e7d-8337-745bac0a8c15 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:16.594872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0870-9ef0-45d3-bd25-41684ef597f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:16.595516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0870-9ef0-45d3-bd25-41684ef597f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:16.595791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0870-9ef0-45d3-bd25-41684ef597f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:16.596060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0870-9ef0-45d3-bd25-41684ef597f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:16.605134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0870-9ef0-45d3-bd25-41684ef597f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:16.606579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0870-9ef0-45d3-bd25-41684ef597f1 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:16.615576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1275/2553] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:19.186903 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:19.255727 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ffa85-f616-4699-beb3-9b6ae34588dd None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:19.260888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:19.261776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:19.262050 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:19.262316 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] PATH_INFO: `/v3/users/5e24b6b251044a11aafab2d423227495` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:19.263584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e24b6b251044a11aafab2d423227495)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:19.265637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:19.315697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e24b6b251044a11aafab2d423227495'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.316323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e24b6b251044a11aafab2d423227495'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.323763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e24b6b251044a11aafab2d423227495'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.336164 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e24b6b251044a11aafab2d423227495'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.344369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e24b6b251044a11aafab2d423227495'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.350530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1279/2554] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:01:19 2022] DELETE /identity/v3/users/5e24b6b251044a11aafab2d423227495 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:19.355174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:19.355680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:19.355786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:19.373334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:19.374523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:19.433070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1276/2555] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:19.443399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:19.445079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:19.502916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a68f9-74fc-4603-88fb-ac906df0adca admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:19.506708 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed132fb-8fc5-4d13-be8f-3913e28490af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:19.507346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed132fb-8fc5-4d13-be8f-3913e28490af service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:19.507623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed132fb-8fc5-4d13-be8f-3913e28490af service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:19.507897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed132fb-8fc5-4d13-be8f-3913e28490af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:19.517597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed132fb-8fc5-4d13-be8f-3913e28490af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:19.519617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed132fb-8fc5-4d13-be8f-3913e28490af service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:19.533915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1280/2556] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:01:19.799505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:19.800990 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:19.813482 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2e7d3-eb2a-410c-ad81-10cabeeb73b1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:19.818161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:19.819049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:19.819768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:19.819768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] PATH_INFO: `/v3/projects/1e57f3c85d7e4d6d831173644f34732d` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:19.820871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e57f3c85d7e4d6d831173644f34732d)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:19.822809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:19.870724 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e57f3c85d7e4d6d831173644f34732d', 'request_id': 'req-2b3a1621-ab01-42be-91ca-cffaac97214c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.880164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e57f3c85d7e4d6d831173644f34732d', 'request_id': 'req-2b3a1621-ab01-42be-91ca-cffaac97214c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.886710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e57f3c85d7e4d6d831173644f34732d', 'request_id': 'req-2b3a1621-ab01-42be-91ca-cffaac97214c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.896857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] The token cache is being invalidate because project 1e57f3c85d7e4d6d831173644f34732d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:01:19.897140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.897779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-2b3a1621-ab01-42be-91ca-cffaac97214c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:19.899359 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1277/2557] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:01:19 2022] DELETE /identity/v3/projects/1e57f3c85d7e4d6d831173644f34732d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:19.905794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:19.906078 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:19.906346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:19.929652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:19.931225 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:19.996735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1281/2558] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:19.999058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:19.999450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:19.999757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.019271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:20.020451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:20.028502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1278/2559] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:20.033013 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.042503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262132e-728c-4af7-86d2-78fea1cba6f5 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.047892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.048543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.048851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.049115 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.049846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:01:20.050147 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.051763 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.064131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1282/2560] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:01:20.068299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.077426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232c5a4-831c-42d5-8422-9911654eb90f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.082228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.082893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.083167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.083437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.084145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.086062 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.114255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1279/2561] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:01:20 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:01:20.118522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.128689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817375b-bc43-4db6-abdd-9a7720f0bee9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.188132 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.188814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.189089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.189359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.190052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.191981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.214456 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1283/2562] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:01:20 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:01:20.220158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.231854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c88a-6564-4cef-8815-6f430514e5ce admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.238080 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.239121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.239390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.239653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.240396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.242078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.259489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1280/2563] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:20.264376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.275839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc986d0-0321-46d9-b925-aaea07c19189 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.281982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d632c6-4a61-45df-ba2e-b5109b40d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.282637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d632c6-4a61-45df-ba2e-b5109b40d5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.282911 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d632c6-4a61-45df-ba2e-b5109b40d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.283177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d632c6-4a61-45df-ba2e-b5109b40d5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.283920 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d632c6-4a61-45df-ba2e-b5109b40d5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.285563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d632c6-4a61-45df-ba2e-b5109b40d5ec admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.296366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1284/2564] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:20.300691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.311129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0ba2-b95c-46f2-8303-568e66182f9a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.316327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.317247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.317521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.317791 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] PATH_INFO: `/v3/projects/f20b995dada24ba182cbb8520c15b1a7/users/0fbffb9c12964293920525e237b6a825/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.334355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20b995dada24ba182cbb8520c15b1a7, user_id=0fbffb9c12964293920525e237b6a825, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.337092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.352556 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1281/2565] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:01:20 2022] PUT /identity/v3/projects/f20b995dada24ba182cbb8520c15b1a7/users/0fbffb9c12964293920525e237b6a825/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:20.363363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.363658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.363927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.390851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] MFA Rules not processed for user `0fbffb9c12964293920525e237b6a825`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:20.392042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:20.453999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1285/2566] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:20.467952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:20.469966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:20.529035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79005-761e-4221-813e-fbcd753a3b0c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:20.533603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:20.534251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:20.534533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:20.534803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:20.543889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:20.545412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:20.554999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1282/2567] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:32.303353 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:32.305416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:32.368032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86246b7-dd06-400f-a536-26d21221cc9e None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:32.372227 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:32.372870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:32.373168 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:32.373428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:32.375444 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:32.459037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:32.461742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:32.474906 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1286/2568] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:36.809078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:36.810857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:36.824368 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730729-54ea-46b5-a383-20d638e84260 service glance] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:36.829004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:36.829641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:36.829926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:36.830186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:36.832243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:36.845947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:36.847365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86d36-b3ed-45fc-9395-74a9ac97fdeb service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:36.859267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1283/2569] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:42.410537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:42.424155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862c3f4-6e33-48e7-a952-87f0315801a6 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:42.427952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:42.428608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:42.429162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:42.429613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:42.438239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:42.525548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:42.527191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:42.546660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1287/2570] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:45.321604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:45.322227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:45.322227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:45.340758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] MFA Rules not processed for user `aa4fbbf421f34df6b34b27f3ee5247b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:45.341977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:45.397608 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1284/2571] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:45.710672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:45.712113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:45.769867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14930-a514-46fb-8844-addc8b5750e7 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:45.773912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:45.774555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:45.774833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:45.775105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:45.777008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:45.787571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:45.789131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:45.797085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1288/2572] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:46.128853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:46.130516 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:46.174758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:46.204217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04d14e-4ed5-4e14-a1d0-a64a4ecea779 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:46.209553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:46.210298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:46.210576 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:46.210847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:46.212601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:46.224396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:46.226078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b6b4-56df-4eb8-889a-2a5ed7c3f839 service placement] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:46.235935 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1285/2573] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:46.236972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d0070-d4ec-4e98-8add-573da6062a3c service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:46.242329 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:46.243210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:46.243488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:46.243756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] PATH_INFO: `/v3/users/0fbffb9c12964293920525e237b6a825` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:46.245004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbffb9c12964293920525e237b6a825)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:46.246953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:46.296404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbffb9c12964293920525e237b6a825'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:46.297080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbffb9c12964293920525e237b6a825'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:46.304633 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbffb9c12964293920525e237b6a825'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:46.316097 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbffb9c12964293920525e237b6a825'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:46.324874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbffb9c12964293920525e237b6a825'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:46.331172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1289/2574] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:01:46 2022] DELETE /identity/v3/users/0fbffb9c12964293920525e237b6a825 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:46.335664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:46.336126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:46.336219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:46.354146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:46.355333 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:46.417040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1286/2575] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:01:46.426974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:46.428362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:46.487376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0b320-17b9-483c-8c63-e3d89bc23394 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:46.491889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82cf44-0280-4f1a-8328-df5ae2748b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:46.492648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82cf44-0280-4f1a-8328-df5ae2748b65 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:46.492966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82cf44-0280-4f1a-8328-df5ae2748b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:46.493241 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82cf44-0280-4f1a-8328-df5ae2748b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:46.503093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82cf44-0280-4f1a-8328-df5ae2748b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:46.504548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82cf44-0280-4f1a-8328-df5ae2748b65 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:46.514412 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1290/2576] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:47.036701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.038357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:47.054094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108dbf5-db12-4eaa-901c-5e16bf4d7ead None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.060246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.061229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.061486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.061814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] PATH_INFO: `/v3/projects/f20b995dada24ba182cbb8520c15b1a7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.062957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20b995dada24ba182cbb8520c15b1a7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.064926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.118172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20b995dada24ba182cbb8520c15b1a7', 'request_id': 'req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:47.126469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20b995dada24ba182cbb8520c15b1a7', 'request_id': 'req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:47.135006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20b995dada24ba182cbb8520c15b1a7', 'request_id': 'req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:47.146371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] The token cache is being invalidate because project f20b995dada24ba182cbb8520c15b1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:01:47.146660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:47.147513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-245c49a3-8fc3-41f9-be3e-b3d7bb01514d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:47.150291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1287/2577] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:01:47 2022] DELETE /identity/v3/projects/f20b995dada24ba182cbb8520c15b1a7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:47.156296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.157128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.157578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.178761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:47.180134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:47.275088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1291/2578] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:47.284295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.284575 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.284871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.307227 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:47.309597 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:47.319065 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1288/2579] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:47.325390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.336361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a516ba-a039-493a-b9d0-220b29677270 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.341732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.342401 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.342673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.342935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.343664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:01:47.343963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.345624 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.358613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1292/2580] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:01:47.362889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.372256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dc7dd-028c-415e-bf91-4c343ece7ff7 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.377031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.377751 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.378165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.378488 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.379265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.381553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.408750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1289/2581] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:01:47 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:01:47.412234 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.422596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257475e-8236-4c3c-a0a7-85448e9af497 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.485597 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.486264 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.486538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.486805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.487511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.489477 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.513884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1293/2582] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:01:47 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:01:47.515138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.527179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71a1c-51be-49bb-946a-e0537bfa14ba admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.532285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.532992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.533279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.533563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.534309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.535943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.549848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1290/2583] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:01:47.551048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.560917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827428-f4d5-4a3c-9aa7-86f82e48a79f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.566884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175325e-d07c-42d4-a57b-23752858c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.567554 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175325e-d07c-42d4-a57b-23752858c78d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.567832 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175325e-d07c-42d4-a57b-23752858c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.568101 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175325e-d07c-42d4-a57b-23752858c78d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.568888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175325e-d07c-42d4-a57b-23752858c78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.570603 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175325e-d07c-42d4-a57b-23752858c78d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.581394 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1294/2584] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:47.585706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.595956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1486a-021c-437a-9eb1-c28b13bfe18f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.601459 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.602366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.602646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.602915 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] PATH_INFO: `/v3/projects/fe3cdc2a5f554bf8a0213ac7f853266c/users/6c61ce1cf1d041df93e1a82878df4fd6/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.617594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3cdc2a5f554bf8a0213ac7f853266c, user_id=6c61ce1cf1d041df93e1a82878df4fd6, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.620228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.635836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1291/2585] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:01:47 2022] PUT /identity/v3/projects/fe3cdc2a5f554bf8a0213ac7f853266c/users/6c61ce1cf1d041df93e1a82878df4fd6/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:01:47.646984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.647350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.647656 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.674960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] MFA Rules not processed for user `6c61ce1cf1d041df93e1a82878df4fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:47.676161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:47.740544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1295/2586] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:47.751422 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:47.753296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:47.809585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe87d0-933d-43fe-a871-1d446a2ed60e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:47.815228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:47.815891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:47.816217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:47.816493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:47.825617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:47.827415 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:47.836421 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1292/2587] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:48.903212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:48.904809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:48.974310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b42686-293e-4c2c-b00e-c5ab16c9aed0 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:48.978735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:48.979400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:48.979684 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:48.979955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:48.981799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:48.992463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:48.994424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa329183-9dd6-422f-973d-c31695e2749c service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:49.003925 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1296/2588] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:54.880523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:54.948083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3a655-7ded-43ee-a425-5e3246a24bcb service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:54.954701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:54.955586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:54.955867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:54.956138 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] PATH_INFO: `/v3/users/6c61ce1cf1d041df93e1a82878df4fd6` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:54.957562 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c61ce1cf1d041df93e1a82878df4fd6)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:54.959551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.010306 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c61ce1cf1d041df93e1a82878df4fd6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.017694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c61ce1cf1d041df93e1a82878df4fd6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.018396 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c61ce1cf1d041df93e1a82878df4fd6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.025402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c61ce1cf1d041df93e1a82878df4fd6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.037402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c61ce1cf1d041df93e1a82878df4fd6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.046176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1293/2589] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:01:54 2022] DELETE /identity/v3/users/6c61ce1cf1d041df93e1a82878df4fd6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:55.048042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.048534 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.048694 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.071224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:55.071224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:55.132382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1297/2590] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:55.142436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.144627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:55.203682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6730e4b-2bc6-4fde-8619-289f7abd4447 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.207971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f837e-ae24-496c-8317-bb64c939a106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.208639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f837e-ae24-496c-8317-bb64c939a106 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.208948 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f837e-ae24-496c-8317-bb64c939a106 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.209223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f837e-ae24-496c-8317-bb64c939a106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.219358 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f837e-ae24-496c-8317-bb64c939a106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.220847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f837e-ae24-496c-8317-bb64c939a106 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.231096 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1294/2591] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:01:55.516494 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.517706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:55.531904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1876531-b711-4509-ad8d-43a8500586ad None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.537326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.538465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.538747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.539020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] PATH_INFO: `/v3/projects/fe3cdc2a5f554bf8a0213ac7f853266c` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.540323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3cdc2a5f554bf8a0213ac7f853266c)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.542381 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.592435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3cdc2a5f554bf8a0213ac7f853266c', 'request_id': 'req-e791e285-8e7b-4be1-bd38-bd2df3928b21'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.598953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3cdc2a5f554bf8a0213ac7f853266c', 'request_id': 'req-e791e285-8e7b-4be1-bd38-bd2df3928b21'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.604299 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3cdc2a5f554bf8a0213ac7f853266c', 'request_id': 'req-e791e285-8e7b-4be1-bd38-bd2df3928b21'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.617160 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] The token cache is being invalidate because project fe3cdc2a5f554bf8a0213ac7f853266c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:01:55.617445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.618052 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-e791e285-8e7b-4be1-bd38-bd2df3928b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:01:55.619613 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1298/2592] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:01:55 2022] DELETE /identity/v3/projects/fe3cdc2a5f554bf8a0213ac7f853266c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:55.626865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.627147 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.627434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.645130 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:55.646230 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:55.707229 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1295/2593] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:55.715579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.715916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.716193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.736409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:55.737660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:55.747675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1299/2594] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:55.752159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.762294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49734ae-e8c4-4d69-9550-39b0f9a49bc6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.769081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.769753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.770029 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.770312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.771027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:01:55.771326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.772949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.785647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1296/2595] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:01:55.790047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.799064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc1357-b274-42f0-9a6e-3aee7345e1a4 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.805119 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.805833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.806095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.806368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.807105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.809106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.840079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1300/2596] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:01:55 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:01:55.841520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.852307 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983daa1-459a-42a2-b440-4f54e37fa76e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.916101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.916801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.917078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.917345 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.918051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.920106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.940758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1297/2597] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:01:55 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:01:55.944671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.955102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3db7d-63d3-4e35-94e3-191a786b5267 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.959781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.960462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.960736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.961014 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.961745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.963349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:55.977298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1301/2598] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:55.978695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:55.988776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740786f-86e2-46a6-b728-86c006a05de4 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:55.993639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420305a2-f7bc-45e6-9c62-73e9bb1544dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:55.994290 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420305a2-f7bc-45e6-9c62-73e9bb1544dd admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:55.994566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420305a2-f7bc-45e6-9c62-73e9bb1544dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:55.994833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420305a2-f7bc-45e6-9c62-73e9bb1544dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:55.995569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420305a2-f7bc-45e6-9c62-73e9bb1544dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:55.997297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420305a2-f7bc-45e6-9c62-73e9bb1544dd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:56.007135 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1298/2599] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:01:56.011351 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:56.021769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb01f-b339-4d47-b8af-1e5809cb3d9c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:56.027169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:56.028074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:56.028405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:56.028679 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] PATH_INFO: `/v3/projects/264ee2f5b580483c85a302041b05c23f/users/6a97115409ba4be989f9071c61df79a5/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:56.043711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=264ee2f5b580483c85a302041b05c23f, user_id=6a97115409ba4be989f9071c61df79a5, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:56.046514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:56.061075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1302/2600] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:01:56 2022] PUT /identity/v3/projects/264ee2f5b580483c85a302041b05c23f/users/6a97115409ba4be989f9071c61df79a5/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:01:56.066195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a889-3a8f-4dc1-9a49-4afd5e2154bb None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:56.066478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a889-3a8f-4dc1-9a49-4afd5e2154bb None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:56.066749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a889-3a8f-4dc1-9a49-4afd5e2154bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:56.085741 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1c41a889-3a8f-4dc1-9a49-4afd5e2154bb None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:01:56.086959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1c41a889-3a8f-4dc1-9a49-4afd5e2154bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:56.149025 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1299/2601] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:01:56.158893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:01:56.161185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:01:56.227914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfa62-93ea-4c2b-8604-f45e71d714fa admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:01:56.233700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:01:56.234346 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:01:56.234641 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:01:56.234904 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:01:56.245384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:01:56.246888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:01:56.257544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1303/2602] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:00.737001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:00.737862 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:00.738281 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:00.765729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] MFA Rules not processed for user `6a97115409ba4be989f9071c61df79a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:00.767014 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:00.835094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1300/2603] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:00.839286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:00.851734 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b5809-583b-4c4f-bcb4-2186b75cab75 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:00.857683 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:00.858463 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:00.858803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:00.859156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:00.859968 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:00.862415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:00.903198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1304/2604] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:00 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:00.905024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:00.919901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fdde3-3e4b-4fe4-9c34-e6f014047304 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:00.976341 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:00.977049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:00.977334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:00.977604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:00.978318 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:00.980271 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.005588 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1301/2605] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:00 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:01.009853 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.031165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aebc8-76f4-41cd-984f-0a20ac2f3c31 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.049081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.050032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.050469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.050894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.051801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.053769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.070091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1305/2606] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:01.071327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.088613 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a9917-b10a-4cc6-af72-1c9f3356cc3b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.093777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.094680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.094956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.095198 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] PATH_INFO: `/v3/projects/92cf629d2e5e4953b30af7efc8d007f6/users/605e0f19733848028965fe69e1692f28/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.115440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cf629d2e5e4953b30af7efc8d007f6, user_id=605e0f19733848028965fe69e1692f28, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.118175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.139382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1302/2607] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:01 2022] PUT /identity/v3/projects/92cf629d2e5e4953b30af7efc8d007f6/users/605e0f19733848028965fe69e1692f28/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:01.140489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.151172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa8580-502b-40b0-a691-f45f1d86ce3f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.226583 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.227506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.228002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.228760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.229927 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.232085 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.245105 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1306/2608] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:02:01.249615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.261256 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cea47a-8ad4-456c-ac27-3ab5e6074357 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.268493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.269603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.269954 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.270294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] PATH_INFO: `/v3/projects/92cf629d2e5e4953b30af7efc8d007f6/users/605e0f19733848028965fe69e1692f28/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.272445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cf629d2e5e4953b30af7efc8d007f6, user_id=605e0f19733848028965fe69e1692f28, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.275299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.287081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1303/2609] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:01 2022] PUT /identity/v3/projects/92cf629d2e5e4953b30af7efc8d007f6/users/605e0f19733848028965fe69e1692f28/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:01.294650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.296383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:01.372102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178442dc-ecb9-4893-bae5-feed363aee7a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.434360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.435447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.435828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.436214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.438535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:01.451211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.452704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f65f25-23bd-45e0-bfcc-2b5a34228dc1 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.489012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1307/2610] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:01.640327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.642217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:01.717182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6977b-5d15-480d-9d72-17dcc09f6c22 None None] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.723106 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6977b-5d15-480d-9d72-17dcc09f6c22 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.723590 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6977b-5d15-480d-9d72-17dcc09f6c22 None None] PATH_INFO: `/` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.730222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1308/2611] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 03:02:01 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 03:02:01.740099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.740373 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.740648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.794666 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] MFA Rules not processed for user `482bb28bcb834632a7354ac78f762ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:01.805536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:01.817011 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c579e2-ff1b-4a9e-bcba-7711fb169977 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.837018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1309/2612] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 03:02:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:01.844403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:01.855108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.855782 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.856161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.856369 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.857279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a0f71-3067-4a70-b28e-79660840f403 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:01.862575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a574222-fec0-4bde-9bc6-19a50d9bb9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:01.863293 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:01.863976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574222-fec0-4bde-9bc6-19a50d9bb9ae service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:01.871303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574222-fec0-4bde-9bc6-19a50d9bb9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:01.872313 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a574222-fec0-4bde-9bc6-19a50d9bb9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:01.883488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a574222-fec0-4bde-9bc6-19a50d9bb9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.886893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a574222-fec0-4bde-9bc6-19a50d9bb9ae service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.894030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:01.896629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:01.908698 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1310/2613] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:02:01.910573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1304/2614] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:06.831836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:06.832376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:06.832376 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:06.859427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] MFA Rules not processed for user `605e0f19733848028965fe69e1692f28`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:06.860689 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:06.928658 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1311/2615] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:06.940296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:06.951580 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9c66-e4c4-4abf-9529-671f00c9d20a service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:06.958030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:06.958900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:06.959174 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:06.959438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:07.016036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:07.017698 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:07.027299 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1305/2616] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:15.271717 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:15.285594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a93198-2ef1-4d27-909a-06b5316f4bbf None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:15.291873 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:15.292801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:15.293082 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:15.293539 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:15.295484 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:15.308183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:15.310055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb3f8-2a6e-40b0-88a3-bbe02aae377b service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:15.322449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1312/2617] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:23.695600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:23.705395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b40a21-bcd8-4e56-aa1f-363fb124ae4e service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:23.709051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:23.709670 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:23.709919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:23.710204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:23.711968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:23.785118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:23.786561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:23.796520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1306/2618] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:24.766178 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:24.766751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:24.766751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:24.784174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] MFA Rules not processed for user `6a97115409ba4be989f9071c61df79a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:24.785485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:24.793074 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1313/2619] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:27.900547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:27.902151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:27.918712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2b2e3-d179-470b-aa2a-848afe04aafa service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:27.925604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:27.926828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:27.927182 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:27.927691 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] PATH_INFO: `/v3/users/076a8d1b26864240a8007d2ac7080e0b` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:27.929452 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=076a8d1b26864240a8007d2ac7080e0b)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:27.931500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:27.993164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076a8d1b26864240a8007d2ac7080e0b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.005389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076a8d1b26864240a8007d2ac7080e0b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.006087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076a8d1b26864240a8007d2ac7080e0b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.014454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076a8d1b26864240a8007d2ac7080e0b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.029190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-154c2976-b3eb-4aab-a253-3134d0719f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076a8d1b26864240a8007d2ac7080e0b'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.036273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1307/2620] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:27 2022] DELETE /identity/v3/users/076a8d1b26864240a8007d2ac7080e0b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:28.228984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.250577 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9af2c-1822-4468-aff9-06717e934cee None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.312000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.312908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.313188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.313460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] PATH_INFO: `/v3/projects/5c189a73642b4f5ba787addbc275d4c0` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.314670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c189a73642b4f5ba787addbc275d4c0)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.316623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.361701 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c189a73642b4f5ba787addbc275d4c0', 'request_id': 'req-54e35cbd-d061-4775-b1d9-da96faa9c6a2'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.369598 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c189a73642b4f5ba787addbc275d4c0', 'request_id': 'req-54e35cbd-d061-4775-b1d9-da96faa9c6a2'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.377654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c189a73642b4f5ba787addbc275d4c0', 'request_id': 'req-54e35cbd-d061-4775-b1d9-da96faa9c6a2'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.393437 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] The token cache is being invalidate because project 5c189a73642b4f5ba787addbc275d4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:28.394716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.395370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-54e35cbd-d061-4775-b1d9-da96faa9c6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:28.397152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1314/2621] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:28 2022] DELETE /identity/v3/projects/5c189a73642b4f5ba787addbc275d4c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:28.403210 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.403718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.403972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.424438 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:28.425958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:28.490409 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1308/2622] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:28.498965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153e4-00d3-4342-b245-149852070f13 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.499355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153e4-00d3-4342-b245-149852070f13 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.499839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153e4-00d3-4342-b245-149852070f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.520471 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-476153e4-00d3-4342-b245-149852070f13 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:28.521743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-476153e4-00d3-4342-b245-149852070f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:28.530350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1315/2623] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:28.534818 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.547273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7fec5-caae-41bd-acb9-176a36e898bd None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.552743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.553439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.553715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.553984 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.554737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:02:28.555040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.556661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.569639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1309/2624] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:02:28.573939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476153e4-00d3-4342-b245-149852070f13 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.583896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476153e4-00d3-4342-b245-149852070f13 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.589529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.590215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.590486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.590787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.591542 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.593547 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.624589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1316/2625] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:28 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:28.629331 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.640980 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34f36-72ea-44d5-b0ae-7260d7784a2e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.722709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.723389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.723654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.723920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.724624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.726686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.746891 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1310/2626] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:28 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:28.750973 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.761383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635ed5-64a8-4475-ba0f-26d12db49e1b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.766618 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.767497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.767794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.768072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.768846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.770480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.784573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1317/2627] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:28.788247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.803835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec574e-a707-4c92-b4c2-d84264b9e4b8 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.811855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aadc09-b2ad-4959-baa0-d1a591e3d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.812554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aadc09-b2ad-4959-baa0-d1a591e3d2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.813638 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aadc09-b2ad-4959-baa0-d1a591e3d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.820467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aadc09-b2ad-4959-baa0-d1a591e3d2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.821596 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aadc09-b2ad-4959-baa0-d1a591e3d2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.823291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aadc09-b2ad-4959-baa0-d1a591e3d2a9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.837190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1311/2628] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:28.838424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:28.849182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e277-3e8c-48d8-9a91-0e766d12dd7c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:28.854086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:28.855018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.855300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.855578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] PATH_INFO: `/v3/projects/b0888cc5c4664b979b37d525074cc327/users/f81051bd3e434b0298dd39970b4b0a6c/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.873693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0888cc5c4664b979b37d525074cc327, user_id=f81051bd3e434b0298dd39970b4b0a6c, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:28.876685 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:28.893312 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1318/2629] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:28 2022] PUT /identity/v3/projects/b0888cc5c4664b979b37d525074cc327/users/f81051bd3e434b0298dd39970b4b0a6c/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:28.903890 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:28.904544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:28.904544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:28.933292 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] MFA Rules not processed for user `f81051bd3e434b0298dd39970b4b0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:28.934770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:29.007180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1312/2630] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:29.018093 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:29.020779 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:29.095460 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f64c4-b2e2-4a24-84b1-147c8bec070b admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:29.101841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2818a-c4d9-44a1-bf27-dc001c31f41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:29.102498 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2818a-c4d9-44a1-bf27-dc001c31f41d service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:29.103322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2818a-c4d9-44a1-bf27-dc001c31f41d service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:29.103322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2818a-c4d9-44a1-bf27-dc001c31f41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:29.111026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2818a-c4d9-44a1-bf27-dc001c31f41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:29.112646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2818a-c4d9-44a1-bf27-dc001c31f41d service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:29.121499 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1319/2631] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:29.297729 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:29.358867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b6e9a-b3f2-43b3-9c81-f96b0cb30711 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:29.363654 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:29.364533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:29.364846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:29.365108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] PATH_INFO: `/v3/users/f81051bd3e434b0298dd39970b4b0a6c` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:29.366338 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81051bd3e434b0298dd39970b4b0a6c)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:29.368289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:29.414904 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81051bd3e434b0298dd39970b4b0a6c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.422768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81051bd3e434b0298dd39970b4b0a6c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.423443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81051bd3e434b0298dd39970b4b0a6c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.430697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81051bd3e434b0298dd39970b4b0a6c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.442867 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81051bd3e434b0298dd39970b4b0a6c'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.448912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1313/2632] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:29 2022] DELETE /identity/v3/users/f81051bd3e434b0298dd39970b4b0a6c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:29.453501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:29.453972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:29.454157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:29.471522 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:29.473121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:29.530465 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1320/2633] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:29.540707 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:29.542260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:29.606895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909712-5a55-4acd-a81e-cef2b6ad3d8c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:29.610873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee681ff-a2ca-4ba1-950d-2e6664c71d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:29.611587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee681ff-a2ca-4ba1-950d-2e6664c71d22 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:29.611786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee681ff-a2ca-4ba1-950d-2e6664c71d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:29.612048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee681ff-a2ca-4ba1-950d-2e6664c71d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:29.621634 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee681ff-a2ca-4ba1-950d-2e6664c71d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:29.623049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee681ff-a2ca-4ba1-950d-2e6664c71d22 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:29.634024 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1314/2634] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:02:29.896326 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:29.898257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:29.913409 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bfa6c-efb7-4241-975b-c73cae5dbaa3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:29.925099 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:29.926036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:29.926337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:29.926607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] PATH_INFO: `/v3/projects/b0888cc5c4664b979b37d525074cc327` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:29.927806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0888cc5c4664b979b37d525074cc327)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:29.929770 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:29.983228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0888cc5c4664b979b37d525074cc327', 'request_id': 'req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.990122 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0888cc5c4664b979b37d525074cc327', 'request_id': 'req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:29.997175 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0888cc5c4664b979b37d525074cc327', 'request_id': 'req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:30.014440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] The token cache is being invalidate because project b0888cc5c4664b979b37d525074cc327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:30.014671 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:30.015297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-cf7bc65f-37b5-44b0-a58b-646b71f76ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:30.018659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1321/2635] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:29 2022] DELETE /identity/v3/projects/b0888cc5c4664b979b37d525074cc327 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:02:30.024936 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.025445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.025568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.051393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:30.052595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:30.119429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1315/2636] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:30.127819 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.128247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.128519 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.148072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:30.149432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:30.159110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1322/2637] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:30.163442 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.173744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41534fa-a383-49ff-85c9-2f870fe0141c None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.179758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.180411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.180689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.180989 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.181726 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:02:30.182026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.183648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.195710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1316/2638] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:02:30.200169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.209814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9399f5-5a09-4495-b25d-87513e03ddf6 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.215361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.216008 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.216281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.216544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.217284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.219215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.248194 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1323/2639] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:30.253005 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.266177 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90d069-a486-4f0a-9ea1-c92a95d13fc9 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.324502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.325269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.325549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.325823 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.326542 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.328444 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.349362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1317/2640] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:30.353696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.363991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36edf2-ebbb-4ac2-9657-b6e1c4cd42d0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.369520 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.370153 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.370431 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.370697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.371435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.373077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.384199 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1324/2641] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:30.388245 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.399039 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514589-f176-4b59-8b0d-c8a965002efa admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.404649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5120e4-06ad-4a22-9285-4f93a86e0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.405355 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5120e4-06ad-4a22-9285-4f93a86e0844 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.405643 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5120e4-06ad-4a22-9285-4f93a86e0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.405914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5120e4-06ad-4a22-9285-4f93a86e0844 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.406659 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5120e4-06ad-4a22-9285-4f93a86e0844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.408379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5120e4-06ad-4a22-9285-4f93a86e0844 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.418810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1318/2642] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:30.423361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.433801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543bd03-c1f0-40a0-882b-b33a7b9de9c2 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.438953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.439884 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.440169 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.440438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] PATH_INFO: `/v3/projects/a71f9d757c0145628b6157d2be3816c0/users/3f94d3e03a3043589f5d76c6dedabafc/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.455874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71f9d757c0145628b6157d2be3816c0, user_id=3f94d3e03a3043589f5d76c6dedabafc, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.458565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.475186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1325/2643] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:30 2022] PUT /identity/v3/projects/a71f9d757c0145628b6157d2be3816c0/users/3f94d3e03a3043589f5d76c6dedabafc/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:30.486742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.487033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.487310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.515886 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] MFA Rules not processed for user `3f94d3e03a3043589f5d76c6dedabafc`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:30.517294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:30.588426 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1319/2644] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:30.593260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.660969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4e1a-f281-4828-bcc0-09e2a2200f91 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.666810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.667464 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.667739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.668017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.668741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.670651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.698161 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1326/2645] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:30.702515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.713676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3defb6-91ed-481b-8af4-5fdbe71453f6 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.774151 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.774735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.775008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.775288 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.775992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.777958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.799832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1320/2646] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:30 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:30.804098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.814538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0689-81cb-497d-a84c-f3b9c7d73f24 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.819623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.820290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.820566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.820870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.821600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.823197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.833965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1327/2647] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:02:30.838334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.848788 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dd65a-a2dc-4f2b-9dcf-3bddaa2f9320 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.853855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.854730 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.855009 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.855280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] PATH_INFO: `/v3/projects/71064b968a6248d8a409ae11151ac0b4/users/2cf8d372bf8c40cbad04896b778a0b8e/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.869517 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71064b968a6248d8a409ae11151ac0b4, user_id=2cf8d372bf8c40cbad04896b778a0b8e, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.872376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.887300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1321/2648] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:30 2022] PUT /identity/v3/projects/71064b968a6248d8a409ae11151ac0b4/users/2cf8d372bf8c40cbad04896b778a0b8e/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:02:30.891337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.901289 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000fc6c-49e6-44a8-9f42-56371df08453 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.961417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761efad-f4d6-496e-bcce-342f90702fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.962091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761efad-f4d6-496e-bcce-342f90702fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.962369 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761efad-f4d6-496e-bcce-342f90702fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.962637 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761efad-f4d6-496e-bcce-342f90702fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.963379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761efad-f4d6-496e-bcce-342f90702fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:30.965025 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761efad-f4d6-496e-bcce-342f90702fb7 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:30.975372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1328/2649] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:30.979776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:30.990424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610ac4c-6b8d-4592-9970-2f34bddb8b31 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:30.995753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:30.996703 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:30.997074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:30.997408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] PATH_INFO: `/v3/projects/71064b968a6248d8a409ae11151ac0b4/users/2cf8d372bf8c40cbad04896b778a0b8e/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:30.999607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71064b968a6248d8a409ae11151ac0b4, user_id=2cf8d372bf8c40cbad04896b778a0b8e, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:31.002362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:31.013872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1322/2650] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:30 2022] PUT /identity/v3/projects/71064b968a6248d8a409ae11151ac0b4/users/2cf8d372bf8c40cbad04896b778a0b8e/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:31.024300 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:31.024561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:31.024802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:31.051191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] MFA Rules not processed for user `2cf8d372bf8c40cbad04896b778a0b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:31.052370 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:31.121032 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1329/2651] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:31.131515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:31.133515 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:31.200013 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f1ae-89e6-422d-957f-b3d7e1830c98 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:31.204651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:31.205357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:31.205621 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:31.205924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:31.215901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:31.217401 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:31.227603 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1323/2652] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:31.301997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:31.312416 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac06f0-e044-48fa-982d-2fff563f1be3 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:31.316866 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d17bb-5c92-4960-8294-059a9a5b774f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:31.317506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d17bb-5c92-4960-8294-059a9a5b774f service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:31.317802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d17bb-5c92-4960-8294-059a9a5b774f service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:31.318069 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d17bb-5c92-4960-8294-059a9a5b774f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:31.381502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d17bb-5c92-4960-8294-059a9a5b774f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:31.383222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d17bb-5c92-4960-8294-059a9a5b774f service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:31.392500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1330/2653] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:41.567476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:41.637092 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329386-21fe-47b5-8ae0-ae2a7d61a1e7 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:41.641549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:41.642697 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:41.642981 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:41.643238 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] PATH_INFO: `/v3/users/3f94d3e03a3043589f5d76c6dedabafc` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:41.644412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f94d3e03a3043589f5d76c6dedabafc)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:41.646611 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:41.694275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f94d3e03a3043589f5d76c6dedabafc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:41.701759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f94d3e03a3043589f5d76c6dedabafc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:41.702431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f94d3e03a3043589f5d76c6dedabafc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:41.709291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f94d3e03a3043589f5d76c6dedabafc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:41.720836 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f94d3e03a3043589f5d76c6dedabafc'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:41.727377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1324/2654] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:41 2022] DELETE /identity/v3/users/3f94d3e03a3043589f5d76c6dedabafc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:41.731961 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:41.732508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:41.732508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:41.749198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:41.750410 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:41.806760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1331/2655] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:41.819451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:41.821312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:41.883395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734a2b6-4fff-4bc7-b9db-f88700685a68 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:41.887468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:41.888113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:41.888392 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:41.888663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:41.898350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:41.899837 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:41.909487 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1325/2656] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:42.181007 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:42.182546 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:42.198612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728e40-31f7-4e6f-8a9a-b18dfee0b82b None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:42.212486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:42.213559 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:42.213834 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:42.214258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] PATH_INFO: `/v3/projects/a71f9d757c0145628b6157d2be3816c0` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:42.218642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71f9d757c0145628b6157d2be3816c0)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:42.218642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:42.277128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71f9d757c0145628b6157d2be3816c0', 'request_id': 'req-49e7d771-978a-4f46-8f00-56b49192c1f0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.283258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71f9d757c0145628b6157d2be3816c0', 'request_id': 'req-49e7d771-978a-4f46-8f00-56b49192c1f0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.288538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71f9d757c0145628b6157d2be3816c0', 'request_id': 'req-49e7d771-978a-4f46-8f00-56b49192c1f0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.301257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] The token cache is being invalidate because project a71f9d757c0145628b6157d2be3816c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:42.301543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.302155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.303700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1332/2657] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:42 2022] DELETE /identity/v3/projects/a71f9d757c0145628b6157d2be3816c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:42.307977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:42.318175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef220-42bd-4321-aa55-637d75f42503 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:42.375781 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:42.376660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:42.376971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:42.377239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] PATH_INFO: `/v3/users/2cf8d372bf8c40cbad04896b778a0b8e` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:42.378678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf8d372bf8c40cbad04896b778a0b8e)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:42.380649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:42.429434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf8d372bf8c40cbad04896b778a0b8e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.438120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf8d372bf8c40cbad04896b778a0b8e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.438737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf8d372bf8c40cbad04896b778a0b8e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.445168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf8d372bf8c40cbad04896b778a0b8e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.457173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6cdd43ec-e065-46b7-baa4-252076dd091e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf8d372bf8c40cbad04896b778a0b8e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.463361 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1326/2658] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:42 2022] DELETE /identity/v3/users/2cf8d372bf8c40cbad04896b778a0b8e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:42.753095 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:42.754653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:42.767818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7d771-978a-4f46-8f00-56b49192c1f0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:42.833288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:42.834185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:42.834644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:42.834926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] PATH_INFO: `/v3/projects/71064b968a6248d8a409ae11151ac0b4` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:42.836214 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] RBAC: Authorizing `identity:delete_project(project_id=71064b968a6248d8a409ae11151ac0b4)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:42.838231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:42.884997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71064b968a6248d8a409ae11151ac0b4', 'request_id': 'req-a0bf94b8-65d4-44cc-a187-924b64cd95df'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.891135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71064b968a6248d8a409ae11151ac0b4', 'request_id': 'req-a0bf94b8-65d4-44cc-a187-924b64cd95df'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.897048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71064b968a6248d8a409ae11151ac0b4', 'request_id': 'req-a0bf94b8-65d4-44cc-a187-924b64cd95df'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.910182 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] The token cache is being invalidate because project 71064b968a6248d8a409ae11151ac0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:42.910469 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.911081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a0bf94b8-65d4-44cc-a187-924b64cd95df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:42.912657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1333/2659] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:42 2022] DELETE /identity/v3/projects/71064b968a6248d8a409ae11151ac0b4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:42.918693 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:42.919314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:42.919314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:42.938193 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:42.939395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:43.004874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1327/2660] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:02:43.010806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.011158 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.011439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.031806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:43.033130 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:43.041579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1334/2661] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:43.046052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.056390 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647b3f-fcb1-4334-a192-a4f4eae0d12f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.062194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.062859 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.063140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.063408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.064161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:02:43.064463 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.066119 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.078794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1328/2662] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:02:43.083284 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.092810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9ae0-815f-4895-bb5d-1a3607fe6762 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.098142 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.098791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.099072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.099393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.100112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.102054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.130735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1335/2663] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:43.135114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.145871 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351b216-6a72-4a16-a514-fcb4d3928ac7 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.201777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.202437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.202718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.202960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.203692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.205647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.229821 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1329/2664] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:43.234247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.244747 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620c404-4db1-40e2-b0f8-56993d52d66f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.249681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.250323 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.250594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.250865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.251596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.253243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.263789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1336/2665] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:02:43.268462 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.281068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782acf30-f61a-4c39-9046-a753f7745107 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.286998 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29449e0e-f9ef-49c2-978d-cf827f26ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.287645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29449e0e-f9ef-49c2-978d-cf827f26ec8e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.287924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29449e0e-f9ef-49c2-978d-cf827f26ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.288195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29449e0e-f9ef-49c2-978d-cf827f26ec8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.288959 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29449e0e-f9ef-49c2-978d-cf827f26ec8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.290723 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29449e0e-f9ef-49c2-978d-cf827f26ec8e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.301979 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1330/2666] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:43.306789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.319995 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c0f5-dbb0-4fc4-86c7-7c205f25e44c admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.327857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.328752 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.329181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.329549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] PATH_INFO: `/v3/projects/175b390650ba4258938c6104004d5ddf/users/cb38f40ded414e19a831118bbbb7c6f7/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.348419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175b390650ba4258938c6104004d5ddf, user_id=cb38f40ded414e19a831118bbbb7c6f7, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.351128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.366829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1337/2667] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:43 2022] PUT /identity/v3/projects/175b390650ba4258938c6104004d5ddf/users/cb38f40ded414e19a831118bbbb7c6f7/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:43.378166 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.378666 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.378968 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.406172 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] MFA Rules not processed for user `cb38f40ded414e19a831118bbbb7c6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:43.407391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:43.473376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1331/2668] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:43.477960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.538030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275dd75-c578-4d02-9c99-f6d2a968e648 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.542864 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.543529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.543809 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.544079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.544833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.546744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.573991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1338/2669] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:43.578049 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.588692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd794352-fc5f-4f45-9db8-a04be3db2a19 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.652641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.653354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.653639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.653884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.654628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.656565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.679134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1332/2670] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:43.683286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.697986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b0f5-210e-4528-9fb4-24ed86c603f3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.702985 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.703643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.703923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.704191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.704963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.706587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.717150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1339/2671] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:43.721222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.731479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804411f-dc9e-4f1d-aa49-b5ff7667fd13 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.736686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6fb7-8980-4d99-84f0-8a938e8def60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.737357 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6fb7-8980-4d99-84f0-8a938e8def60 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.737630 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6fb7-8980-4d99-84f0-8a938e8def60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.737895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6fb7-8980-4d99-84f0-8a938e8def60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.738631 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6fb7-8980-4d99-84f0-8a938e8def60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.740219 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6fb7-8980-4d99-84f0-8a938e8def60 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.750104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1333/2672] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:02:43.754073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.764146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811be96-7f82-40a9-a2d8-0d141d412404 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.769332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.770188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.770467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.770731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] PATH_INFO: `/v3/projects/342d09c04bb14811a79db7fb2fcb1916/users/1daae2a166274ea2ac768c9049705723/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.785415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342d09c04bb14811a79db7fb2fcb1916, user_id=1daae2a166274ea2ac768c9049705723, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.788090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:43.803204 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1340/2673] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:43 2022] PUT /identity/v3/projects/342d09c04bb14811a79db7fb2fcb1916/users/1daae2a166274ea2ac768c9049705723/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:02:43.813629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.813914 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.814184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.840087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] MFA Rules not processed for user `1daae2a166274ea2ac768c9049705723`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:43.841317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:43.908286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1334/2674] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:43.912910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:43.973974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9c54-be35-4a87-bbcc-0b75c9396943 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:43.978805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:43.979448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:43.979723 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:43.979991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:43.980690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:43.982620 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.011371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1341/2675] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:43 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:44.016872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.028056 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb0ef-b435-41c7-bc53-721ffa34abeb None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.087019 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.087769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.088037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.088282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.089069 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.091004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.116952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1335/2676] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:44 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:44.119145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.129569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5994111-6e34-41f9-bc38-dd291e65665e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.134882 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.135580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.135862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.136133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.136981 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.138563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.153009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1342/2677] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:44.154236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.164676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82488a-aa35-4414-9a54-b95640284547 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.170469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.171360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.171640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.171896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] PATH_INFO: `/v3/projects/8b268e7792c0478284dd8e38138c184e/users/b6051db4b3fd4654a88bf47b9e9fa5ba/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.188921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b268e7792c0478284dd8e38138c184e, user_id=b6051db4b3fd4654a88bf47b9e9fa5ba, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.191536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.197764 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.199765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:44.206015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1336/2678] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:44 2022] PUT /identity/v3/projects/8b268e7792c0478284dd8e38138c184e/users/b6051db4b3fd4654a88bf47b9e9fa5ba/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:44.209708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.259145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd68841-1668-4af9-9a8d-86dfeeb382ea admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.270190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff2f10-763a-41a6-98dd-295f258af323 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.275495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.276279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.276559 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.276874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.277764 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.279412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.289319 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1337/2679] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:02:44.293510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.303152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3719-f97f-4c12-818d-6dcf1c01ea8d admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.306244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.306887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.307163 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.307436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.308017 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab608ca-46a9-4a69-84da-c38062991eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.308920 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab608ca-46a9-4a69-84da-c38062991eca admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.309196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab608ca-46a9-4a69-84da-c38062991eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.309296 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:44.309465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab608ca-46a9-4a69-84da-c38062991eca admin admin] PATH_INFO: `/v3/projects/8b268e7792c0478284dd8e38138c184e/users/b6051db4b3fd4654a88bf47b9e9fa5ba/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.311445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab608ca-46a9-4a69-84da-c38062991eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b268e7792c0478284dd8e38138c184e, user_id=b6051db4b3fd4654a88bf47b9e9fa5ba, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.314140 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab608ca-46a9-4a69-84da-c38062991eca admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.326758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1338/2680] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:44 2022] PUT /identity/v3/projects/8b268e7792c0478284dd8e38138c184e/users/b6051db4b3fd4654a88bf47b9e9fa5ba/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:44.337966 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.338194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.338485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.369757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] MFA Rules not processed for user `b6051db4b3fd4654a88bf47b9e9fa5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:44.370947 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:44.378718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.380145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.390012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1343/2681] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:02:44.441932 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1339/2682] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:02:44.451736 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.453237 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:44.513817 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f205ec3-12d1-4ff6-9529-5cf592b37494 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.560367 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.561053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.561336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.561596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.571626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.573210 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.584458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1344/2683] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:44.635003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:44.636481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:44.648322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eda442-9b11-4e9c-9d7a-95fd5c2dfa86 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:44.652313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c92e-03fd-46ea-9003-d86d321c5e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:44.653003 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c92e-03fd-46ea-9003-d86d321c5e5a service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:44.653327 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c92e-03fd-46ea-9003-d86d321c5e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:44.653605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c92e-03fd-46ea-9003-d86d321c5e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:44.712180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0c92e-03fd-46ea-9003-d86d321c5e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:44.713669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0c92e-03fd-46ea-9003-d86d321c5e5a service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:44.723669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1340/2684] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:47.576333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:47.642659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e723-9779-4e96-a083-e9861147f655 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:47.647181 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:47.648048 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:47.648322 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:47.648592 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] PATH_INFO: `/v3/users/cb38f40ded414e19a831118bbbb7c6f7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:47.649915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb38f40ded414e19a831118bbbb7c6f7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:47.651828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:47.701049 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb38f40ded414e19a831118bbbb7c6f7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:47.701938 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb38f40ded414e19a831118bbbb7c6f7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:47.712201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb38f40ded414e19a831118bbbb7c6f7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:47.725064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb38f40ded414e19a831118bbbb7c6f7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:47.734474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb38f40ded414e19a831118bbbb7c6f7'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:47.740608 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1345/2685] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:47 2022] DELETE /identity/v3/users/cb38f40ded414e19a831118bbbb7c6f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:47.746819 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:47.747286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:47.747286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:47.774200 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:47.775498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:47.834478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1341/2686] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:47.844348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:47.845865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:47.904334 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f56ec-7ab1-48d5-a4bf-578c7a2085a4 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:47.908283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:47.908971 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:47.909257 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:47.909512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:47.918755 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:47.920207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:47.933518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1346/2687] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:48.195553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:48.197168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:48.209404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965917-de73-42a4-8625-4ab6c14c6d8e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:48.216443 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:48.217363 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:48.217639 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:48.217908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] PATH_INFO: `/v3/projects/175b390650ba4258938c6104004d5ddf` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:48.221897 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=175b390650ba4258938c6104004d5ddf)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:48.224176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:48.272552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175b390650ba4258938c6104004d5ddf', 'request_id': 'req-a2e942b3-54ae-4224-9c90-9ae6b54442f6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.283473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175b390650ba4258938c6104004d5ddf', 'request_id': 'req-a2e942b3-54ae-4224-9c90-9ae6b54442f6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.289528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175b390650ba4258938c6104004d5ddf', 'request_id': 'req-a2e942b3-54ae-4224-9c90-9ae6b54442f6'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.299832 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] The token cache is being invalidate because project 175b390650ba4258938c6104004d5ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:48.300110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.300752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.302316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1342/2688] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:48 2022] DELETE /identity/v3/projects/175b390650ba4258938c6104004d5ddf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:48.306498 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:48.316739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9936e-2008-47f8-a220-8e0faada3c6d service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:48.373375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:48.374293 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:48.374575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:48.374850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] PATH_INFO: `/v3/users/1daae2a166274ea2ac768c9049705723` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:48.376103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1daae2a166274ea2ac768c9049705723)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:48.378113 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:48.427517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1daae2a166274ea2ac768c9049705723'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.428191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1daae2a166274ea2ac768c9049705723'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.435275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1daae2a166274ea2ac768c9049705723'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.449291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1daae2a166274ea2ac768c9049705723'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.457761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1daae2a166274ea2ac768c9049705723'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.464088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1347/2689] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:48 2022] DELETE /identity/v3/users/1daae2a166274ea2ac768c9049705723 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:48.747809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:48.749263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:48.762072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e942b3-54ae-4224-9c90-9ae6b54442f6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:48.817393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:48.818197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:48.818508 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:48.818779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] PATH_INFO: `/v3/projects/342d09c04bb14811a79db7fb2fcb1916` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:48.820110 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=342d09c04bb14811a79db7fb2fcb1916)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:48.822141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:48.876493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342d09c04bb14811a79db7fb2fcb1916', 'request_id': 'req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.888366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342d09c04bb14811a79db7fb2fcb1916', 'request_id': 'req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.895414 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342d09c04bb14811a79db7fb2fcb1916', 'request_id': 'req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.907470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] The token cache is being invalidate because project 342d09c04bb14811a79db7fb2fcb1916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:48.907755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.908554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:48.910282 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1343/2690] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:48 2022] DELETE /identity/v3/projects/342d09c04bb14811a79db7fb2fcb1916 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:48.914567 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:48.916273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:48.929711 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30db0c3-a58d-4d10-8502-0808067cf5cb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:48.989514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:48.990417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:48.990690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:48.990959 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] PATH_INFO: `/v3/users/b6051db4b3fd4654a88bf47b9e9fa5ba` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:48.992649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6051db4b3fd4654a88bf47b9e9fa5ba)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:48.995493 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.045218 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6051db4b3fd4654a88bf47b9e9fa5ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.045849 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6051db4b3fd4654a88bf47b9e9fa5ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.052569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6051db4b3fd4654a88bf47b9e9fa5ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.065026 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6051db4b3fd4654a88bf47b9e9fa5ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.074527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b93a5409-e39f-4073-a9d0-4e497e7cd135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6051db4b3fd4654a88bf47b9e9fa5ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.080963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1348/2691] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:02:48 2022] DELETE /identity/v3/users/b6051db4b3fd4654a88bf47b9e9fa5ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:49.345156 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.346960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:49.359718 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6087a37-c828-4c06-90e4-7b6cd8eeb79f admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.422405 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.423265 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.423536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.423802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] PATH_INFO: `/v3/projects/8b268e7792c0478284dd8e38138c184e` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.425136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b268e7792c0478284dd8e38138c184e)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.427048 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.477710 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b268e7792c0478284dd8e38138c184e', 'request_id': 'req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.487629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b268e7792c0478284dd8e38138c184e', 'request_id': 'req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.493957 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b268e7792c0478284dd8e38138c184e', 'request_id': 'req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.508560 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] The token cache is being invalidate because project 8b268e7792c0478284dd8e38138c184e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:02:49.508893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.509565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9b93bec8-30c5-4dcf-93b7-0ae9a4712197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:02:49.511194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1344/2692] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:02:49 2022] DELETE /identity/v3/projects/8b268e7792c0478284dd8e38138c184e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:49.519589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.520055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.520511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.548294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:49.549626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:49.609566 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1349/2693] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:49.617794 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.618086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.618365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.642257 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:49.643623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:49.651804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1345/2694] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:49.656242 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.666187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947ce2-405b-499a-82fd-5eb72be6c06a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.670969 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.671662 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.671939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.672206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.672982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:02:49.673283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.674931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.686756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1350/2695] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:02:49.691391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.700587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c2f9a-58e8-4130-81a5-4de0d24d7806 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.705783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.706470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.706784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.707090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.707795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.709720 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.738448 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1346/2696] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:49 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:49.742617 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.752428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652cca-e9bf-4b74-8de4-fde0fd648ef3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.815858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.816536 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.816848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.817128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.817828 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.819910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.843390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1351/2697] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:49 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:49.848058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.858492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3e7f-b791-4555-a05f-1e8338981241 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.864407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.865028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.865296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.865558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.866285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.867905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.879773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1347/2698] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:49.883991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.894290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b4e42-4f08-4fc4-9246-cfc6d875bf87 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.899466 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440caa-c93c-4e40-adb0-96a74ea2572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.900114 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440caa-c93c-4e40-adb0-96a74ea2572a admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.900386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440caa-c93c-4e40-adb0-96a74ea2572a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.900654 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440caa-c93c-4e40-adb0-96a74ea2572a admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.901490 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06440caa-c93c-4e40-adb0-96a74ea2572a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.903096 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06440caa-c93c-4e40-adb0-96a74ea2572a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.913103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1352/2699] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:49.917332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:49.927578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599a7f-9be0-4de6-8456-ff40bdef720e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:49.932895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:49.933774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.934055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.934316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] PATH_INFO: `/v3/projects/ef5bde70ec00452887ed8a4489e3d7b5/users/7b4c79abccd149c1b9ce978a8ddb1fb0/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.948987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5bde70ec00452887ed8a4489e3d7b5, user_id=7b4c79abccd149c1b9ce978a8ddb1fb0, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:49.951629 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:49.966146 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1348/2700] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:49 2022] PUT /identity/v3/projects/ef5bde70ec00452887ed8a4489e3d7b5/users/7b4c79abccd149c1b9ce978a8ddb1fb0/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:49.971664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974f08-d8ed-4a18-bc75-45b57e99e445 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:49.972129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974f08-d8ed-4a18-bc75-45b57e99e445 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:49.972253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974f08-d8ed-4a18-bc75-45b57e99e445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:49.990751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-68974f08-d8ed-4a18-bc75-45b57e99e445 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:49.991923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-68974f08-d8ed-4a18-bc75-45b57e99e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:50.050018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1353/2701] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:50.059960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:50.062137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:50.121873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd57ba-ef6f-49c9-85e0-9ab684bb5fef admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:50.125930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:50.126571 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:50.126865 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:50.127134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:50.137020 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:50.138486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:50.148057 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1349/2702] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:50.787155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:50.787449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:50.787700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:50.821421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] MFA Rules not processed for user `7b4c79abccd149c1b9ce978a8ddb1fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:50.822750 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:50.898246 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1354/2703] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:02:50.902721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:50.912232 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25e9b-26f9-4745-8d0b-8e3ae84c57e4 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:50.916848 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:50.917526 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:50.917800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:50.918099 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:50.918795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:50.920754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:50.946855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1350/2704] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:02:50 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:02:50.951131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:50.961595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d832-3ba3-41be-b114-3c22cac8ceb1 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:51.014395 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:51.015062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:51.015317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:51.015579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:51.016265 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:51.018222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:51.043039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1355/2705] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:02:50 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:02:51.047168 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:51.057496 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf71f6-8fa7-4025-a03c-e4c212c5a646 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:51.062395 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:51.063046 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:51.063320 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:51.063590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:51.064328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:51.065965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:51.076472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1351/2706] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:51.080652 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:51.090650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06dc29-6400-4c9b-b9f6-56af177e0cf3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:51.095703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:51.096984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:51.097258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:51.097523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] PATH_INFO: `/v3/projects/2c5d9d81ed6b4090bd589ad6f6c81bba/users/7fe94d702e754b689a16b51724c0ac2f/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:51.112216 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5d9d81ed6b4090bd589ad6f6c81bba, user_id=7fe94d702e754b689a16b51724c0ac2f, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:51.114914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:51.129718 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1356/2707] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:51 2022] PUT /identity/v3/projects/2c5d9d81ed6b4090bd589ad6f6c81bba/users/7fe94d702e754b689a16b51724c0ac2f/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:51.133800 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:51.143725 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621e1cc-2507-4806-bc51-df7d59e2849c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:51.201469 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f30b0f-4085-417c-8b50-fdbe97df6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:51.202045 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30b0f-4085-417c-8b50-fdbe97df6d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:51.202326 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30b0f-4085-417c-8b50-fdbe97df6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:51.202618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30b0f-4085-417c-8b50-fdbe97df6d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:51.203347 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30b0f-4085-417c-8b50-fdbe97df6d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:51.204996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30b0f-4085-417c-8b50-fdbe97df6d9a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:51.215734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1352/2708] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:02:51.220143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:51.231572 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71785-2aaf-4c6d-bc6c-b7e06f59ba04 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:51.237476 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:51.238389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:51.238643 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:51.238916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] PATH_INFO: `/v3/projects/2c5d9d81ed6b4090bd589ad6f6c81bba/users/7fe94d702e754b689a16b51724c0ac2f/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:51.241144 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5d9d81ed6b4090bd589ad6f6c81bba, user_id=7fe94d702e754b689a16b51724c0ac2f, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:51.243791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:51.254848 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1357/2709] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:02:51 2022] PUT /identity/v3/projects/2c5d9d81ed6b4090bd589ad6f6c81bba/users/7fe94d702e754b689a16b51724c0ac2f/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:02:51.861815 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:51.862169 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:51.862507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:51.891236 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] MFA Rules not processed for user `7fe94d702e754b689a16b51724c0ac2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:02:51.892587 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:51.970893 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1353/2710] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:02:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:02:51.982024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:51.983982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:52.052338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beaa9e-50d1-4813-9dd3-ef2209a37bce admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:52.056496 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7987dff-e185-43de-90b6-feb7ca5b6817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:52.057315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7987dff-e185-43de-90b6-feb7ca5b6817 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:52.057839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7987dff-e185-43de-90b6-feb7ca5b6817 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:52.058187 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7987dff-e185-43de-90b6-feb7ca5b6817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:52.124907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7987dff-e185-43de-90b6-feb7ca5b6817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:52.126488 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7987dff-e185-43de-90b6-feb7ca5b6817 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:52.136631 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1358/2711] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:02:53.479350 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:02:53.481408 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:02:53.493531 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15793-cbca-4aa9-b596-bd019eead08b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:02:53.497677 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:02:53.498336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:02:53.498609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:02:53.498882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:02:53.508185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:02:53.509652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:02:53.518945 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1354/2712] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:02:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:05.104487 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:05.104974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:05.105064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:05.122428 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:05.123605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:05.188754 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1359/2713] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 03:03:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:05.238088 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:05.239609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:05.308066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a8c7-8d60-481d-aa6d-17a7c2845eac service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:05.314252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:05.314901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:05.315298 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:05.315573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:05.324074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:05.325901 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:05.334619 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1355/2714] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:03:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:03:06.657173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:06.739992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54e030-8bf9-4f4e-b303-5904c6ce760c None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:06.745485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:06.746549 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:06.746916 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:06.747447 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] PATH_INFO: `/v3/users/7b4c79abccd149c1b9ce978a8ddb1fb0` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:06.748796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4c79abccd149c1b9ce978a8ddb1fb0)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:06.750885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:06.805825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4c79abccd149c1b9ce978a8ddb1fb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:06.806599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4c79abccd149c1b9ce978a8ddb1fb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:06.813761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4c79abccd149c1b9ce978a8ddb1fb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:06.826636 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4c79abccd149c1b9ce978a8ddb1fb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:06.836068 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4c79abccd149c1b9ce978a8ddb1fb0'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:06.842964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1360/2715] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:03:06 2022] DELETE /identity/v3/users/7b4c79abccd149c1b9ce978a8ddb1fb0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:07.042958 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:07.068064 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d16c-d3c8-4b35-95d2-2c2e3d048007 service swift] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:07.137072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:07.137952 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:07.138225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:07.138495 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] PATH_INFO: `/v3/projects/ef5bde70ec00452887ed8a4489e3d7b5` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:07.142451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5bde70ec00452887ed8a4489e3d7b5)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:07.144483 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:07.203077 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5bde70ec00452887ed8a4489e3d7b5', 'request_id': 'req-94973612-981d-4b21-b386-0f31997d5373'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.214312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5bde70ec00452887ed8a4489e3d7b5', 'request_id': 'req-94973612-981d-4b21-b386-0f31997d5373'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.221969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5bde70ec00452887ed8a4489e3d7b5', 'request_id': 'req-94973612-981d-4b21-b386-0f31997d5373'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.236949 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] The token cache is being invalidate because project ef5bde70ec00452887ed8a4489e3d7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:03:07.237231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.237873 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.239419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1356/2716] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:03:07 2022] DELETE /identity/v3/projects/ef5bde70ec00452887ed8a4489e3d7b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:07.243387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:07.248341 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:07.266523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6dc5-d927-4f93-a057-fe24ac513c62 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:07.334584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:07.335855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:07.336133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:07.336415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] PATH_INFO: `/v3/users/7fe94d702e754b689a16b51724c0ac2f` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:07.337686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe94d702e754b689a16b51724c0ac2f)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:07.339670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:07.398527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:07.401111 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:07.402294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe94d702e754b689a16b51724c0ac2f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.403010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe94d702e754b689a16b51724c0ac2f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.411732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe94d702e754b689a16b51724c0ac2f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.424794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe94d702e754b689a16b51724c0ac2f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.440687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe94d702e754b689a16b51724c0ac2f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.451411 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1361/2717] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:03:07 2022] DELETE /identity/v3/users/7fe94d702e754b689a16b51724c0ac2f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:07.504429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94973612-981d-4b21-b386-0f31997d5373 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:07.581846 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:07.582944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:07.583323 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:07.583692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:07.586610 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:07.678398 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:07.679822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:07.681224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:07.682864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bd490-27e7-4b6f-b460-b2965f1768f8 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:07.696916 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1357/2718] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:03:07.773713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2d56f-67ce-4e02-bafe-57ffcda91bb0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:07.778996 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:07.779953 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:07.780485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:07.781012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] PATH_INFO: `/v3/projects/2c5d9d81ed6b4090bd589ad6f6c81bba` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:07.782298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5d9d81ed6b4090bd589ad6f6c81bba)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:07.784364 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:07.836803 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5d9d81ed6b4090bd589ad6f6c81bba', 'request_id': 'req-b141f16e-0f67-42fb-aad2-19d552f9768f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.846393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5d9d81ed6b4090bd589ad6f6c81bba', 'request_id': 'req-b141f16e-0f67-42fb-aad2-19d552f9768f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.852333 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5d9d81ed6b4090bd589ad6f6c81bba', 'request_id': 'req-b141f16e-0f67-42fb-aad2-19d552f9768f'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.873870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] The token cache is being invalidate because project 2c5d9d81ed6b4090bd589ad6f6c81bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:03:07.874358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.875272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b141f16e-0f67-42fb-aad2-19d552f9768f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:07.877244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1362/2719] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:03:07 2022] DELETE /identity/v3/projects/2c5d9d81ed6b4090bd589ad6f6c81bba => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:07.888181 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:07.888470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:07.888767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:07.911547 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:07.912757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:07.980167 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1358/2720] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:07.988678 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:07.989102 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:07.989436 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.010892 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:08.012133 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:08.021664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1363/2721] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:08.029925 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.040218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e1a80-3f2d-4078-80d3-dec691536ce1 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.046225 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.046996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.047969 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.048255 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.049031 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:03:08.049332 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.056768 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.083934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1359/2722] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:03:08.090531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.100798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692cb7-9a36-4f4f-b2fa-702d607f5874 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.106184 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.107167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.107551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.107955 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.108998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.111110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.148621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1364/2723] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:03:08 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:03:08.153733 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.165636 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8fa0-b279-4485-93e3-127c1ec35fca admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.235861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.237196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.237573 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.237939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.239329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.241485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.272655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1360/2724] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:03:08 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:03:08.277027 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.288087 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aa17f-a72d-47ef-9f54-dbc578d13816 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.293116 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.293888 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.294298 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.294663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.295639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.297573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.315135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1365/2725] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:03:08.316328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.327633 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31275a-92e8-473f-878e-8b83ff08bccf admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.332563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4ed34-886d-4068-9ed7-6838489aafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.333188 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4ed34-886d-4068-9ed7-6838489aafa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.333535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4ed34-886d-4068-9ed7-6838489aafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.333908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4ed34-886d-4068-9ed7-6838489aafa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.334732 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4ed34-886d-4068-9ed7-6838489aafa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.336400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4ed34-886d-4068-9ed7-6838489aafa0 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.348038 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1361/2726] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:03:08.352445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.363283 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5287509-1361-450a-bbfc-21777606a0ad admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.368282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.369360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.369504 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.369868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] PATH_INFO: `/v3/projects/12b721b50d954ab5a578b1daf1948cf0/users/268e6048e84f48dc8ad9265513d368ba/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.385422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b721b50d954ab5a578b1daf1948cf0, user_id=268e6048e84f48dc8ad9265513d368ba, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.389167 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.410839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1366/2727] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:03:08 2022] PUT /identity/v3/projects/12b721b50d954ab5a578b1daf1948cf0/users/268e6048e84f48dc8ad9265513d368ba/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:08.422148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af299-9610-47ec-b8ef-b25a5e29cd95 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.422437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af299-9610-47ec-b8ef-b25a5e29cd95 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.422719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af299-9610-47ec-b8ef-b25a5e29cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.453445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-709af299-9610-47ec-b8ef-b25a5e29cd95 None None] MFA Rules not processed for user `268e6048e84f48dc8ad9265513d368ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:08.455075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-709af299-9610-47ec-b8ef-b25a5e29cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:08.534267 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1362/2728] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:08.547815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:08.549839 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:08.609914 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a6f8-db34-4c7e-8018-5d2651e2466f admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:08.614605 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87614b0d-8698-4897-a066-8dd1f2c8c7e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:08.615563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87614b0d-8698-4897-a066-8dd1f2c8c7e6 service glance] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:08.616039 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87614b0d-8698-4897-a066-8dd1f2c8c7e6 service glance] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:08.616625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87614b0d-8698-4897-a066-8dd1f2c8c7e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:08.629818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87614b0d-8698-4897-a066-8dd1f2c8c7e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:08.631696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87614b0d-8698-4897-a066-8dd1f2c8c7e6 service glance] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:08.642473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1367/2729] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:18.433744 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df7589-c002-42b3-b78f-c2c60d46eb77 None None] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:18.434295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df7589-c002-42b3-b78f-c2c60d46eb77 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:18.434423 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df7589-c002-42b3-b78f-c2c60d46eb77 None None] PATH_INFO: `/` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:18.436300 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1363/2730] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 3 03:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 03 03:03:18.441502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38073f-0ce8-4154-a85f-d76a42edb9aa None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:18.441923 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38073f-0ce8-4154-a85f-d76a42edb9aa None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:18.442173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38073f-0ce8-4154-a85f-d76a42edb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:18.462110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9e38073f-0ce8-4154-a85f-d76a42edb9aa None None] MFA Rules not processed for user `a5e2802cd72344deb281b227f9acb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:18.463315 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9e38073f-0ce8-4154-a85f-d76a42edb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:18.534719 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1368/2731] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 3 03:03:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:18.545824 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df7589-c002-42b3-b78f-c2c60d46eb77 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:18.547539 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-29df7589-c002-42b3-b78f-c2c60d46eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:18.560804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df7589-c002-42b3-b78f-c2c60d46eb77 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:18.565376 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:18.566101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:18.566474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:18.566854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:18.578101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:18.579541 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:18.590231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1364/2732] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:03:20.390517 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:20.391004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:20.391103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:20.410320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:20.411538 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:20.470930 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1369/2733] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:20.483095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:20.484827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:20.554939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599ceb-b4e4-4bfc-a932-d5a9f6428a9f service glance] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:20.562060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40f9f7-6202-4ec5-81dc-677604565bbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:20.562829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40f9f7-6202-4ec5-81dc-677604565bbb service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:20.563228 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40f9f7-6202-4ec5-81dc-677604565bbb service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:20.563513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40f9f7-6202-4ec5-81dc-677604565bbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:20.578885 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40f9f7-6202-4ec5-81dc-677604565bbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:20.581072 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40f9f7-6202-4ec5-81dc-677604565bbb service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:20.594114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1365/2734] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:03:26.339309 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:26.410758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d25598-6860-4876-9e6a-c28fdffa0fb2 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:26.415523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:26.416403 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:26.416673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:26.416974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] PATH_INFO: `/v3/users/268e6048e84f48dc8ad9265513d368ba` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:26.418208 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=268e6048e84f48dc8ad9265513d368ba)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:26.420177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:26.472491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268e6048e84f48dc8ad9265513d368ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:26.473255 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268e6048e84f48dc8ad9265513d368ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:26.481137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268e6048e84f48dc8ad9265513d368ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:26.503129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268e6048e84f48dc8ad9265513d368ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:26.512660 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268e6048e84f48dc8ad9265513d368ba'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:26.518948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1370/2735] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:03:26 2022] DELETE /identity/v3/users/268e6048e84f48dc8ad9265513d368ba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:26.523695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:26.524280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:26.524280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:26.541857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:26.543354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:26.604962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1366/2736] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:26.614935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:26.616396 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:26.682945 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe51dd-a97a-4456-af32-0fb02ba9c165 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:26.686895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62071-f5c2-46fe-a4a0-1b1fd546a0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:26.687544 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62071-f5c2-46fe-a4a0-1b1fd546a0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:26.687825 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62071-f5c2-46fe-a4a0-1b1fd546a0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:26.688086 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62071-f5c2-46fe-a4a0-1b1fd546a0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:26.697967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea62071-f5c2-46fe-a4a0-1b1fd546a0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:26.699445 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea62071-f5c2-46fe-a4a0-1b1fd546a0f3 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:26.710134 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1371/2737] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:27.412704 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.414243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:27.433685 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf0ed-a156-4eae-bb52-6adae9c85f1b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.438500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.439373 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.439645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.439911 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] PATH_INFO: `/v3/projects/12b721b50d954ab5a578b1daf1948cf0` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.441235 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b721b50d954ab5a578b1daf1948cf0)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:27.443145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:27.509753 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b721b50d954ab5a578b1daf1948cf0', 'request_id': 'req-fdf84e1a-cb44-4536-9807-fad5945d0ee5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:27.521279 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b721b50d954ab5a578b1daf1948cf0', 'request_id': 'req-fdf84e1a-cb44-4536-9807-fad5945d0ee5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:27.529313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b721b50d954ab5a578b1daf1948cf0', 'request_id': 'req-fdf84e1a-cb44-4536-9807-fad5945d0ee5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:27.540159 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] The token cache is being invalidate because project 12b721b50d954ab5a578b1daf1948cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:03:27.540471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:27.541127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fdf84e1a-cb44-4536-9807-fad5945d0ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:27.542695 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1367/2738] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:03:27 2022] DELETE /identity/v3/projects/12b721b50d954ab5a578b1daf1948cf0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:27.548575 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.549107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.549223 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.567804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:27.569192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:27.643857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1372/2739] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:27.652113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.653224 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.653511 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.677525 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:27.679429 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:27.688296 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1368/2740] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:27.692806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.703508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76988b-949f-4622-9a72-56e2382dec51 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.708362 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.714889 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.715297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.715669 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.716560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:03:27.716997 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:27.718749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:27.731612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1373/2741] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:03:27.736223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.746289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32da57-982b-4501-9f2e-d62e17351384 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.751340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.752004 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.752291 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.752550 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.753301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:27.755313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:27.789746 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1369/2742] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:03:27 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:03:27.790833 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.801432 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06da2-b054-401f-8331-753f472add46 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.861991 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.862673 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.863005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.863272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.863995 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:27.865964 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:27.894073 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1374/2743] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:03:27 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:03:27.895468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.905950 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229251a6-d962-4bb6-93cc-75d72eb2d54a admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.911086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.911983 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.912322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.912674 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.913520 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:27.915240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:27.926827 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1370/2744] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:03:27.934045 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.945059 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad44c55-7bfb-45a5-b098-a961ea5de357 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.950079 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442aee-86f8-4b7d-9fe3-71429d4bc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.950786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442aee-86f8-4b7d-9fe3-71429d4bc6ff admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.951066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442aee-86f8-4b7d-9fe3-71429d4bc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.951368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442aee-86f8-4b7d-9fe3-71429d4bc6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:27.952290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f442aee-86f8-4b7d-9fe3-71429d4bc6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:27.954193 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f442aee-86f8-4b7d-9fe3-71429d4bc6ff admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:27.966005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1375/2745] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:03:27.970706 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:27.981783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4f869-a59d-47ed-b5b5-5b7ca9b915dc admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:27.987035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:27.988018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:27.988302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:27.988563 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] PATH_INFO: `/v3/projects/b43ba2790aac4dd39998bd14015f09ca/users/32a757c63ae54c03963c274c867df5be/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:28.004139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43ba2790aac4dd39998bd14015f09ca, user_id=32a757c63ae54c03963c274c867df5be, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:28.006905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:28.020829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1371/2746] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:03:27 2022] PUT /identity/v3/projects/b43ba2790aac4dd39998bd14015f09ca/users/32a757c63ae54c03963c274c867df5be/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:28.033691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:28.033978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:28.034252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:28.066399 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] MFA Rules not processed for user `32a757c63ae54c03963c274c867df5be`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:28.067562 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:28.138550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1376/2747] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:28.166577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:28.168343 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:28.243544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133be8-253a-46a2-99cc-c55afe692138 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:28.250879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dd828-769c-4b76-b936-a2c63adcb4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:28.250879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dd828-769c-4b76-b936-a2c63adcb4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:28.253992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dd828-769c-4b76-b936-a2c63adcb4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:28.253992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dd828-769c-4b76-b936-a2c63adcb4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:28.262743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dd828-769c-4b76-b936-a2c63adcb4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:28.264528 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dd828-769c-4b76-b936-a2c63adcb4c7 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:28.275735 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1372/2748] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:28.292081 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:28.355188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34f447-725b-43cb-832a-92fd27ffcd1d None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:28.359699 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:28.360584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:28.360901 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:28.361173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] PATH_INFO: `/v3/users/32a757c63ae54c03963c274c867df5be` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:28.362402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a757c63ae54c03963c274c867df5be)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:28.364400 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:28.415191 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a757c63ae54c03963c274c867df5be'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:28.417156 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a757c63ae54c03963c274c867df5be'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:28.425256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a757c63ae54c03963c274c867df5be'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:28.437928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a757c63ae54c03963c274c867df5be'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:28.446876 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a757c63ae54c03963c274c867df5be'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:28.453789 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1377/2749] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:03:28 2022] DELETE /identity/v3/users/32a757c63ae54c03963c274c867df5be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:28.458617 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:28.458982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:28.459348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:28.486522 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:28.487943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:28.578708 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1373/2750] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:28.600201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:28.602348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:28.675596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c995-3c2a-4398-bdfa-5a0b25195685 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:28.679215 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101dedf-a851-43dc-91a1-26ed9f66ca13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:28.679858 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101dedf-a851-43dc-91a1-26ed9f66ca13 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:28.680135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101dedf-a851-43dc-91a1-26ed9f66ca13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:28.680405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101dedf-a851-43dc-91a1-26ed9f66ca13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:28.690259 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101dedf-a851-43dc-91a1-26ed9f66ca13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:28.691758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101dedf-a851-43dc-91a1-26ed9f66ca13 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:28.702446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1378/2751] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:28.996694 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:28.998801 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:29.010561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4544-e910-462f-8c3e-0809198ab5bc None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.015075 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.015934 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.016208 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.016476 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] PATH_INFO: `/v3/projects/b43ba2790aac4dd39998bd14015f09ca` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.017769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43ba2790aac4dd39998bd14015f09ca)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.019764 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.073247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43ba2790aac4dd39998bd14015f09ca', 'request_id': 'req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:29.082689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43ba2790aac4dd39998bd14015f09ca', 'request_id': 'req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:29.090745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43ba2790aac4dd39998bd14015f09ca', 'request_id': 'req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:29.103996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] The token cache is being invalidate because project b43ba2790aac4dd39998bd14015f09ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:03:29.104280 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:29.105033 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-bcb9c06d-40b4-4b02-8370-d91a9cb2e6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:29.106895 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1374/2752] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:03:28 2022] DELETE /identity/v3/projects/b43ba2790aac4dd39998bd14015f09ca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:29.112815 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.113103 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.113375 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.130814 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:29.132017 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:29.194967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1379/2753] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:29.202919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.203197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.203455 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.228179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:29.229431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:29.239328 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1375/2754] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:29.243748 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.253894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf749edb-f033-4686-aecb-9e68ba3c4010 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.261020 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.261907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.262229 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.262557 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.263607 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:03:29.263984 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.266599 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.279162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1380/2755] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:03:29.283470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.293795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab962018-b412-4e7d-af08-48cbc37d467e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.299784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.300582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.300896 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.301164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.301870 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.303770 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.332026 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1376/2756] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:03:29 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:03:29.336390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.347092 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33cee-47a1-47f5-a789-90ac538499ea admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.406042 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.406709 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.407012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.407278 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.407966 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.409954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.432287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1381/2757] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:03:29 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:03:29.436568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.447081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0363a1-b70e-4753-be6a-0488135d1f64 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.452102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.452783 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.453059 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.453325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.454061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.455655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.466074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1377/2758] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:03:29.470018 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.480887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3daf3-243d-4eab-afdf-a56d14ee68c0 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.486665 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd43ad-7e28-410f-b21b-c508a37ad77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.487310 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd43ad-7e28-410f-b21b-c508a37ad77b admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.487585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd43ad-7e28-410f-b21b-c508a37ad77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.487854 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd43ad-7e28-410f-b21b-c508a37ad77b admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.488611 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd43ad-7e28-410f-b21b-c508a37ad77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.490273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd43ad-7e28-410f-b21b-c508a37ad77b admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.500670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1382/2759] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:03:29.504804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.515066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd24e1-3cf3-4460-909b-d8daa5f81f44 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.520593 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.521507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.521787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.522058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] PATH_INFO: `/v3/projects/75a68a1b96ee4033bf683db87d2c6cfc/users/c4ba512a106549b2b072c40fd33bebcb/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.536503 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a68a1b96ee4033bf683db87d2c6cfc, user_id=c4ba512a106549b2b072c40fd33bebcb, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.539190 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.555393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1378/2760] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:03:29 2022] PUT /identity/v3/projects/75a68a1b96ee4033bf683db87d2c6cfc/users/c4ba512a106549b2b072c40fd33bebcb/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:29.560502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc44937-aa14-4b71-9b25-bcdb9e6f551a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.560976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc44937-aa14-4b71-9b25-bcdb9e6f551a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.561249 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc44937-aa14-4b71-9b25-bcdb9e6f551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.579141 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9cc44937-aa14-4b71-9b25-bcdb9e6f551a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:29.580339 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9cc44937-aa14-4b71-9b25-bcdb9e6f551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:29.641812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1383/2761] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:29.651187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:29.655679 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:29.714136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777dee-3858-4009-a12b-7e5d5a21000b admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:29.717734 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:29.718377 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:29.718651 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:29.718910 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:29.728594 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:29.730102 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:29.739745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1379/2762] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:33.601021 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:33.601500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:33.601500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:33.650419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] MFA Rules not processed for user `c4ba512a106549b2b072c40fd33bebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:33.653812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:33.774783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1384/2763] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:33.778642 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:33.789601 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667037-dfee-449d-a432-8c3ee36dc110 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:33.795008 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:33.796787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:33.797513 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:33.797942 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:33.799523 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:33.802294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:33.841863 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1380/2764] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:03:33 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:03:33.846230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:33.864273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd3a1c-ecd7-42a2-9b42-c142e626247f None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:33.960426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:33.961810 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:33.962366 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:33.962850 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:33.965639 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:33.967778 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:33.993393 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1385/2765] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:03:33 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:03:33.999126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:34.011207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eac14c-65f8-4188-bf62-4c5af9553fe2 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:34.017400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:34.018627 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:34.019221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:34.019673 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:34.020803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:34.022869 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:34.040895 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:34.041322 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1381/2766] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:03:34.053196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97d73-086e-4bf0-be70-757169193c31 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:34.060091 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:34.061332 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:34.061765 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:34.062201 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] PATH_INFO: `/v3/projects/754093811911452e9c216cb971b60309/users/b58f7dd4d7654b7489130a2f80070bc4/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:34.081016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754093811911452e9c216cb971b60309, user_id=b58f7dd4d7654b7489130a2f80070bc4, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:34.085457 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:34.106514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1386/2767] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:03:34 2022] PUT /identity/v3/projects/754093811911452e9c216cb971b60309/users/b58f7dd4d7654b7489130a2f80070bc4/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:34.108234 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:34.119141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9edc-d0cf-4c8a-8704-76d5e1e4671e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:34.182854 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa955c-03af-4f79-ab65-a3d2b46d0af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:34.183139 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa955c-03af-4f79-ab65-a3d2b46d0af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:34.183393 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa955c-03af-4f79-ab65-a3d2b46d0af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:34.183676 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa955c-03af-4f79-ab65-a3d2b46d0af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:34.184419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa955c-03af-4f79-ab65-a3d2b46d0af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:34.188252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa955c-03af-4f79-ab65-a3d2b46d0af7 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:34.203231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1382/2768] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:03:34.207657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:34.218177 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733a2d9-ccc4-4751-bb9f-268072519fc3 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:34.224579 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:34.225261 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:34.225514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:34.225813 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] PATH_INFO: `/v3/projects/754093811911452e9c216cb971b60309/users/b58f7dd4d7654b7489130a2f80070bc4/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:34.227822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=754093811911452e9c216cb971b60309, user_id=b58f7dd4d7654b7489130a2f80070bc4, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:34.230606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:34.241672 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1387/2769] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:03:34 2022] PUT /identity/v3/projects/754093811911452e9c216cb971b60309/users/b58f7dd4d7654b7489130a2f80070bc4/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:35.239579 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:35.240612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:35.241083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:35.261294 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:35.262533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:35.346927 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1383/2770] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 3 03:03:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:35.360783 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:35.362787 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:35.437402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfb24f-8ee2-4c16-9740-fbc8b3a78f9a admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:35.442793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a21b87-bb54-4bfb-918e-074d1a19ca3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:35.443503 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21b87-bb54-4bfb-918e-074d1a19ca3f service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:35.443792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21b87-bb54-4bfb-918e-074d1a19ca3f service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:35.444589 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21b87-bb54-4bfb-918e-074d1a19ca3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:35.453273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a21b87-bb54-4bfb-918e-074d1a19ca3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:35.454886 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a21b87-bb54-4bfb-918e-074d1a19ca3f service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:35.463818 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1388/2771] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:03:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:03:37.846068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:37.987701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1144c-dcd8-488a-9cc3-6d183d11caac None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:38.000510 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:38.001348 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:38.001722 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:38.005263 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:38.008641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:38.135402 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:38.137802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:38.153378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1384/2772] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:39.288859 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b65b-a96a-4ad7-a332-321449ab4d84 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:39.289773 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b65b-a96a-4ad7-a332-321449ab4d84 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:39.290053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b65b-a96a-4ad7-a332-321449ab4d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:39.329822 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-00c0b65b-a96a-4ad7-a332-321449ab4d84 None None] MFA Rules not processed for user `b58f7dd4d7654b7489130a2f80070bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:39.331230 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-00c0b65b-a96a-4ad7-a332-321449ab4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:39.413419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1389/2773] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:39.429187 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:39.430731 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:39.499378 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcaa9c-5501-40d7-8f65-4d70a310f79f service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:39.503491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a83aa4460fb48469b62d1069358ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:39.504372 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:39.504646 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:39.504972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:39.569082 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:39.570977 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:39.581774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1385/2774] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:39.779948 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:39.780384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:39.781080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:39.813857 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:39.815267 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:39.842618 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:39.850863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1390/2775] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 03:03:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:39.855700 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87593c46-adf3-453a-ba4d-1f121f7c5350 service glance] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:39.862268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed01e-af6b-4e72-a56b-497ca6d5d0d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:39.863176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed01e-af6b-4e72-a56b-497ca6d5d0d0 service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:39.863683 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed01e-af6b-4e72-a56b-497ca6d5d0d0 service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:39.864161 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed01e-af6b-4e72-a56b-497ca6d5d0d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:39.876807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed01e-af6b-4e72-a56b-497ca6d5d0d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:39.879305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed01e-af6b-4e72-a56b-497ca6d5d0d0 service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:39.890269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1386/2776] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:03:44.047501 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:44.058728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcb99-cef1-4f70-b46c-e4d631ea4efe None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:44.070644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:44.073053 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:44.074379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:44.074844 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:44.077939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:44.160977 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:44.162508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:44.172527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1391/2777] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:03:50.278743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:50.279250 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:50.279351 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:50.302657 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] MFA Rules not processed for user `c4ba512a106549b2b072c40fd33bebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:50.303881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:50.311774 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1387/2778] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:03:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:51.663609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:51.665170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:51.679474 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b196e0c-3cc9-466f-ae79-1848cabe61db service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:51.688518 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:51.689550 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:51.690003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:51.690371 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] PATH_INFO: `/v3/users/2eb1f6ef4005482f8dba7efb00068639` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:51.691757 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb1f6ef4005482f8dba7efb00068639)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:51.694070 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:51.770670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb1f6ef4005482f8dba7efb00068639'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:51.771337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb1f6ef4005482f8dba7efb00068639'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:51.781896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb1f6ef4005482f8dba7efb00068639'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:51.796801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb1f6ef4005482f8dba7efb00068639'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:51.804686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb1f6ef4005482f8dba7efb00068639'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:51.811207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1392/2779] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:03:51 2022] DELETE /identity/v3/users/2eb1f6ef4005482f8dba7efb00068639 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:03:51.977660 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:51.990269 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e5f27-b003-45aa-8e7a-a05782d9172d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:52.051330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:52.052233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:52.052505 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:52.052810 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] PATH_INFO: `/v3/projects/4cde077871f94db3a608b5b79c01883e` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:52.054030 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cde077871f94db3a608b5b79c01883e)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:52.056060 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:52.105786 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cde077871f94db3a608b5b79c01883e', 'request_id': 'req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.113246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cde077871f94db3a608b5b79c01883e', 'request_id': 'req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.119686 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cde077871f94db3a608b5b79c01883e', 'request_id': 'req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.131742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] The token cache is being invalidate because project 4cde077871f94db3a608b5b79c01883e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:03:52.132032 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.132806 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-b91b8a69-1b83-44cb-a664-1e0cb81c2ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.134680 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1388/2780] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:03:51 2022] DELETE /identity/v3/projects/4cde077871f94db3a608b5b79c01883e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:52.138594 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:52.140256 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:52.153908 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149256c2-e2a8-4cbd-b08d-31197d66d669 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:52.236389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:52.237523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:52.237867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:52.238337 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] PATH_INFO: `/v3/users/144cbd561c0f4246a71ce020865d1712` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:52.239543 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144cbd561c0f4246a71ce020865d1712)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:52.241514 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:52.293303 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144cbd561c0f4246a71ce020865d1712'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.294004 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144cbd561c0f4246a71ce020865d1712'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.300929 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144cbd561c0f4246a71ce020865d1712'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.312003 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144cbd561c0f4246a71ce020865d1712'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.319896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144cbd561c0f4246a71ce020865d1712'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.325781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1393/2781] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:03:52 2022] DELETE /identity/v3/users/144cbd561c0f4246a71ce020865d1712 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:03:52.403938 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:52.404309 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:52.404585 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:52.424976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:03:52.426877 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:52.493561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1389/2782] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 3 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:03:52.506880 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:52.508311 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:52.511195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:03:52.512682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:03:52.591605 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8b9b-c2f3-479c-9f42-ae3f3b1692e8 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:52.595439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b7cb-00ab-4cc2-b011-1e018bb234d1 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:03:52.597595 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:52.598472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:52.598747 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:52.599015 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] PATH_INFO: `/v3/projects/81cffb18ef6f4455ac919fcbf571016a` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:52.600561 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cffb18ef6f4455ac919fcbf571016a)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:52.602558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:52.609998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:03:52.609998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:03:52.609998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:03:52.610438 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:03:52.621793 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:03:52.623722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:03:52.640894 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1394/2783] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:03:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 03 03:03:52.658122 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cffb18ef6f4455ac919fcbf571016a', 'request_id': 'req-0a45ba13-0b01-4855-b09e-a8fca82f90bb'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.667439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cffb18ef6f4455ac919fcbf571016a', 'request_id': 'req-0a45ba13-0b01-4855-b09e-a8fca82f90bb'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.675175 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cffb18ef6f4455ac919fcbf571016a', 'request_id': 'req-0a45ba13-0b01-4855-b09e-a8fca82f90bb'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.687412 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] The token cache is being invalidate because project 81cffb18ef6f4455ac919fcbf571016a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:03:52.687940 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.688833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:03:52.690889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1390/2784] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:03:52 2022] DELETE /identity/v3/projects/81cffb18ef6f4455ac919fcbf571016a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:17.097729 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:17.099183 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:17.157601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41563e9-182c-4a23-8d6e-a69eb30924cb service swift] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:17.205121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:17.205760 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:17.206005 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:17.206280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:17.208196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:17.269497 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:17.271239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:17.280874 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1395/2785] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:18.021721 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:18.023537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:18.036485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ba13-0b01-4855-b09e-a8fca82f90bb admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:18.040305 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:18.041040 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:18.041317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:18.041586 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:18.044570 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:18.107215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:18.108689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:18.118196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1391/2786] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:19.651023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:19.652570 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:19.788492 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06f8f-042a-43d6-bf64-963f8d574a19 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:19.795744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:19.796417 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:19.796695 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:19.797012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:19.800359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:19.835010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:19.836693 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:19.848627 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1396/2787] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:22.471460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:22.472471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:22.485757 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aa865-f95c-4445-b30b-98a1a76b7b77 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:22.494451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:22.495389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:22.495780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:22.496148 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] PATH_INFO: `/v3/users/aa4fbbf421f34df6b34b27f3ee5247b1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:22.498054 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4fbbf421f34df6b34b27f3ee5247b1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:22.500436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:22.548872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4fbbf421f34df6b34b27f3ee5247b1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.560114 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4fbbf421f34df6b34b27f3ee5247b1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.560898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4fbbf421f34df6b34b27f3ee5247b1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.569222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4fbbf421f34df6b34b27f3ee5247b1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.580507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-fb7cbf67-ee54-47d2-872d-195dc1ffd4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4fbbf421f34df6b34b27f3ee5247b1'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.586533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1392/2788] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:22 2022] DELETE /identity/v3/users/aa4fbbf421f34df6b34b27f3ee5247b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:22.760136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:22.771239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073718-c8cd-4bf2-a44a-5ac7e1cd93cc service nova] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:22.826435 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:22.827290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:22.827574 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:22.827845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] PATH_INFO: `/v3/projects/e8467ff017574f36b1c31db5579a56ce` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:22.829675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8467ff017574f36b1c31db5579a56ce)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:22.832772 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:22.892600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8467ff017574f36b1c31db5579a56ce', 'request_id': 'req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.901453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8467ff017574f36b1c31db5579a56ce', 'request_id': 'req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.909179 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8467ff017574f36b1c31db5579a56ce', 'request_id': 'req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.926350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] The token cache is being invalidate because project e8467ff017574f36b1c31db5579a56ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:22.926625 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.927275 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d48cae0c-53a4-4d0d-bd3e-ed5d92b19d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:22.928885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1397/2789] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:22 2022] DELETE /identity/v3/projects/e8467ff017574f36b1c31db5579a56ce => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:22.937118 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:22.937532 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:22.937960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:22.959602 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:22.960850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:23.020490 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1393/2790] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:23.029561 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.029936 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.030318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.052143 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:23.053384 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:23.062350 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1398/2791] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:23.066577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.076820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf56b25-db40-433b-b727-f1b281d4d99e None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.082688 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.083387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.083664 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.083933 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.084682 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:04:23.085018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.086653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.099445 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1394/2792] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:04:23.104343 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.113928 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5769bc-1c73-49ba-854a-8a7c20e4a695 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.119781 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.120425 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.120680 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.120976 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.121664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.123600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.153405 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1399/2793] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:23.158202 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.172055 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132338f1-68ca-4491-9199-4d356ac62b29 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.232486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.233186 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.233465 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.233728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.234427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.236764 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.261807 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1395/2794] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:23.266314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.277475 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991f908-5725-47ac-a2ad-9979852c76ba admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.283426 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.284084 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.284363 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.284635 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.285422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.287044 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.298022 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1400/2795] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:23.302162 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.312972 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb208aa-df6c-4a06-a6a5-bd3a0dda6d6e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.318218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62657e3-1c0f-43a1-9857-3f19daacd9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.318905 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62657e3-1c0f-43a1-9857-3f19daacd9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.319233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62657e3-1c0f-43a1-9857-3f19daacd9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.319504 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62657e3-1c0f-43a1-9857-3f19daacd9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.320240 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62657e3-1c0f-43a1-9857-3f19daacd9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.321856 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62657e3-1c0f-43a1-9857-3f19daacd9b3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.331607 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1396/2796] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:23.335565 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.351135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff018-7815-4d9a-ac9a-dd6672a7c48d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.358797 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.360016 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.360321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.360647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] PATH_INFO: `/v3/projects/baa1f7d686614bc2a90842bdde1d4744/users/3e5753f170f14807b84174e27dd38626/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.378761 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa1f7d686614bc2a90842bdde1d4744, user_id=3e5753f170f14807b84174e27dd38626, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.381553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.396207 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1401/2797] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:23 2022] PUT /identity/v3/projects/baa1f7d686614bc2a90842bdde1d4744/users/3e5753f170f14807b84174e27dd38626/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:04:23.407424 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.407820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.408127 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.434266 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] MFA Rules not processed for user `3e5753f170f14807b84174e27dd38626`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:23.435485 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:23.505918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1397/2798] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:23.510999 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.578162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d29ad-d2e0-41c1-a921-9dea25015b15 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.584478 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.585162 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.585439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.585722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.586414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.588324 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.616910 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1402/2799] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:23.622470 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.634239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53bffd-8d83-4679-bea7-cb6b8f8e80e3 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.691951 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.692645 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.692962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.693246 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.693976 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.695956 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.721134 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1398/2800] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:23.722489 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.734023 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8c0f6-5ee4-4aab-82a1-13f9f2a25774 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.739576 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.740250 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.740532 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.740872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.741604 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.743258 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.754950 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1403/2801] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:23.760743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.770922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55895f5-4ac1-497d-92aa-12e41a287ad6 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.776176 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.777100 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.777379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.777655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] PATH_INFO: `/v3/projects/adf2432695fb4f8cbd65ada8ab3b128b/users/8768209ead5a451abad08651093d48d8/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.792838 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf2432695fb4f8cbd65ada8ab3b128b, user_id=8768209ead5a451abad08651093d48d8, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.795500 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.810302 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1399/2802] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:23 2022] PUT /identity/v3/projects/adf2432695fb4f8cbd65ada8ab3b128b/users/8768209ead5a451abad08651093d48d8/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:23.814281 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.824386 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f01f5-0808-4117-ba90-4f89c45cec75 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.879205 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ab03-8f80-478d-84be-73cbc582decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.879791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ab03-8f80-478d-84be-73cbc582decb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.880090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ab03-8f80-478d-84be-73cbc582decb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.880359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ab03-8f80-478d-84be-73cbc582decb admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.881121 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ab03-8f80-478d-84be-73cbc582decb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.882751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ab03-8f80-478d-84be-73cbc582decb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.892500 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1404/2803] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:23.896861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:23.907251 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bdd3f-a2b0-47e7-9b5e-95e2eb80b08e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:23.911974 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:23.912882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.913158 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.913418 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] PATH_INFO: `/v3/projects/adf2432695fb4f8cbd65ada8ab3b128b/users/8768209ead5a451abad08651093d48d8/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.915466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf2432695fb4f8cbd65ada8ab3b128b, user_id=8768209ead5a451abad08651093d48d8, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:23.918129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:23.928623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1400/2804] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:23 2022] PUT /identity/v3/projects/adf2432695fb4f8cbd65ada8ab3b128b/users/8768209ead5a451abad08651093d48d8/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:23.938943 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:23.939290 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:23.939606 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:23.967687 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] MFA Rules not processed for user `8768209ead5a451abad08651093d48d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:23.969307 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:24.039646 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1405/2805] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:24.050624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:24.053475 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:24.113457 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19d83-d426-4eb6-8b82-b42e559b2106 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:24.117394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:24.118037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:24.118314 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:24.118584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:24.127847 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:24.129400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:24.138737 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1401/2806] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:24.208638 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:24.219239 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1990b-a510-4166-95fe-45499f21a0ee None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:24.223402 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f3032-fcdf-40db-917d-1a011de619e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:24.224024 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3032-fcdf-40db-917d-1a011de619e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:24.224317 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3032-fcdf-40db-917d-1a011de619e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:24.224609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3032-fcdf-40db-917d-1a011de619e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:24.281157 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f3032-fcdf-40db-917d-1a011de619e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:24.282820 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f3032-fcdf-40db-917d-1a011de619e8 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:24.294075 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1406/2807] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:24.561828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:24.632310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173fcd-e4e4-467b-90d2-4d20bc5bb296 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:24.640918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:24.641962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:24.642339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:24.642632 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] PATH_INFO: `/v3/users/3e5753f170f14807b84174e27dd38626` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:24.644481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5753f170f14807b84174e27dd38626)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:24.648243 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:24.699554 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5753f170f14807b84174e27dd38626'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:24.709802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5753f170f14807b84174e27dd38626'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:24.710564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5753f170f14807b84174e27dd38626'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:24.717313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5753f170f14807b84174e27dd38626'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:24.728924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5753f170f14807b84174e27dd38626'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:24.735209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1402/2808] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:24 2022] DELETE /identity/v3/users/3e5753f170f14807b84174e27dd38626 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:24.739867 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:24.740150 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:24.740422 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:24.758571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:24.759780 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:24.822881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1407/2809] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:24.835194 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:24.837078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:24.903568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff469c1-ac70-42b6-94c9-bf95fe20ea2c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:24.908180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:24.908872 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:24.909155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:24.909440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:24.919701 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:24.921209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:24.931125 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1403/2810] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:25.199155 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:25.200670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:25.212921 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c097d8-d2fe-4668-a161-ca8e5fa1cc13 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:25.218272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:25.219513 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:25.219786 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:25.220054 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] PATH_INFO: `/v3/projects/baa1f7d686614bc2a90842bdde1d4744` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:25.221387 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa1f7d686614bc2a90842bdde1d4744)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:25.223301 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:25.271413 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa1f7d686614bc2a90842bdde1d4744', 'request_id': 'req-7c1dcbad-08b4-47e8-a619-db02c7ae9953'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.277502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa1f7d686614bc2a90842bdde1d4744', 'request_id': 'req-7c1dcbad-08b4-47e8-a619-db02c7ae9953'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.283062 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa1f7d686614bc2a90842bdde1d4744', 'request_id': 'req-7c1dcbad-08b4-47e8-a619-db02c7ae9953'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.297963 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] The token cache is being invalidate because project baa1f7d686614bc2a90842bdde1d4744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:25.298245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.298899 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.300480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1408/2811] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:25 2022] DELETE /identity/v3/projects/baa1f7d686614bc2a90842bdde1d4744 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:04:25.304527 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:25.316780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d1962-bba4-49ff-987a-1fc8ca72355f service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:25.379481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:25.380352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:25.380628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:25.380923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] PATH_INFO: `/v3/users/8768209ead5a451abad08651093d48d8` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:25.382141 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8768209ead5a451abad08651093d48d8)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:25.384086 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:25.430507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8768209ead5a451abad08651093d48d8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.438604 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8768209ead5a451abad08651093d48d8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.439204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8768209ead5a451abad08651093d48d8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.445809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8768209ead5a451abad08651093d48d8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.456566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-6a36597d-4a7c-411f-b82e-c27ffcf8ca73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8768209ead5a451abad08651093d48d8'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.462407 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1404/2812] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:25 2022] DELETE /identity/v3/users/8768209ead5a451abad08651093d48d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:25.747804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:25.749458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:25.764571 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dcbad-08b4-47e8-a619-db02c7ae9953 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:25.821847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:25.822690 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:25.822986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:25.823558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] PATH_INFO: `/v3/projects/adf2432695fb4f8cbd65ada8ab3b128b` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:25.824455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf2432695fb4f8cbd65ada8ab3b128b)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:25.826383 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:25.872224 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf2432695fb4f8cbd65ada8ab3b128b', 'request_id': 'req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.878212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf2432695fb4f8cbd65ada8ab3b128b', 'request_id': 'req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.883700 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf2432695fb4f8cbd65ada8ab3b128b', 'request_id': 'req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.896865 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] The token cache is being invalidate because project adf2432695fb4f8cbd65ada8ab3b128b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:25.897172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.897883 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8223cc41-6dfd-4d13-a12a-cc4da2b4e187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:25.899585 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1409/2813] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:25 2022] DELETE /identity/v3/projects/adf2432695fb4f8cbd65ada8ab3b128b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:25.906051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15db5c-17eb-4add-828b-03db92253460 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:25.906535 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15db5c-17eb-4add-828b-03db92253460 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:25.906637 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15db5c-17eb-4add-828b-03db92253460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:25.926887 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-be15db5c-17eb-4add-828b-03db92253460 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:25.928104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-be15db5c-17eb-4add-828b-03db92253460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:25.990763 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1405/2814] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:25.998642 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:25.998926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:25.999209 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.017686 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:26.018868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:26.027118 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1410/2815] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:26.031898 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15db5c-17eb-4add-828b-03db92253460 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.045743 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15db5c-17eb-4add-828b-03db92253460 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.053142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.054078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.054431 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.054699 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.055437 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:04:26.055728 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.057365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.068955 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1406/2816] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:04:26.073361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.083165 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b6a83-bb92-420e-b126-05c926b25a7a None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.088560 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.089248 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.089527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.089796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.090578 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.092509 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.121703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1411/2817] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:26 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:26.126041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.136143 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd9f5-1852-4867-ab4e-ba0976b0d9c3 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.202413 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.203078 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.203354 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.203623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.204313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.206286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.231857 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1407/2818] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:26 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:26.236172 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.247088 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee85-096a-4240-a5ba-49f41948c8b6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.252462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.253188 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.253467 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.253744 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.254483 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.256112 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.269746 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1412/2819] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:26.273960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.284066 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d691-b13a-4cfb-bd29-d20b7413d73e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.289058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c4b57-6425-4dd5-8a61-dc64cb0558bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.289715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4b57-6425-4dd5-8a61-dc64cb0558bf admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.289992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4b57-6425-4dd5-8a61-dc64cb0558bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.290276 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4b57-6425-4dd5-8a61-dc64cb0558bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.291027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4b57-6425-4dd5-8a61-dc64cb0558bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.292635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4b57-6425-4dd5-8a61-dc64cb0558bf admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.302400 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1408/2820] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:26.306530 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.316318 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4335-a8a2-425e-a163-9b151acbe2eb admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.321270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.322140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.322424 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.322691 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] PATH_INFO: `/v3/projects/4186f53410814f00a151d4c36eafd6c0/users/3f2e08896afa446aa1bb792f17ca19ab/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.336944 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4186f53410814f00a151d4c36eafd6c0, user_id=3f2e08896afa446aa1bb792f17ca19ab, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.339731 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.356804 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1413/2821] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:26 2022] PUT /identity/v3/projects/4186f53410814f00a151d4c36eafd6c0/users/3f2e08896afa446aa1bb792f17ca19ab/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:26.371460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.371749 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.372108 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.400223 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] MFA Rules not processed for user `3f2e08896afa446aa1bb792f17ca19ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:26.401474 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:26.466387 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1409/2822] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:26.476915 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.478756 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:26.538632 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e70e0-1c6e-403d-bf84-2521d8f8110e admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.542836 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173a412-d7a3-4dda-a9dd-909f69717784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.543485 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a412-d7a3-4dda-a9dd-909f69717784 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.543771 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a412-d7a3-4dda-a9dd-909f69717784 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.544047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a412-d7a3-4dda-a9dd-909f69717784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.553012 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a412-d7a3-4dda-a9dd-909f69717784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.554563 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a412-d7a3-4dda-a9dd-909f69717784 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.563527 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1414/2823] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:26.588536 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.654275 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c630f-31cf-4bb9-98e7-6e2900d3fc2b None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.659641 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.660506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.660802 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.661067 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] PATH_INFO: `/v3/users/3f2e08896afa446aa1bb792f17ca19ab` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.662362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2e08896afa446aa1bb792f17ca19ab)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.664301 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.723037 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2e08896afa446aa1bb792f17ca19ab'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:26.732178 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2e08896afa446aa1bb792f17ca19ab'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:26.732919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2e08896afa446aa1bb792f17ca19ab'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:26.739903 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2e08896afa446aa1bb792f17ca19ab'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:26.751564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2e08896afa446aa1bb792f17ca19ab'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:26.757715 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1410/2824] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:26 2022] DELETE /identity/v3/users/3f2e08896afa446aa1bb792f17ca19ab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:26.762372 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.762653 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.762926 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.780796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:26.782000 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:26.850348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1415/2825] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:26.860095 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:26.861692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:26.923053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a65f4-62fd-406e-b5a0-5fefa44d6161 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:26.928106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6671c2d-4e1a-4a4e-8266-7f2a11ad1f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:26.928760 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671c2d-4e1a-4a4e-8266-7f2a11ad1f42 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:26.929058 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671c2d-4e1a-4a4e-8266-7f2a11ad1f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:26.929339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671c2d-4e1a-4a4e-8266-7f2a11ad1f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:26.940553 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6671c2d-4e1a-4a4e-8266-7f2a11ad1f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:26.941999 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6671c2d-4e1a-4a4e-8266-7f2a11ad1f42 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:26.951750 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1411/2826] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:04:27.233682 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.235195 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:27.247377 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93802e-fdf8-421d-8e1b-9e9948ada217 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.252863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.253933 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.254252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.254529 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] PATH_INFO: `/v3/projects/4186f53410814f00a151d4c36eafd6c0` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.255791 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4186f53410814f00a151d4c36eafd6c0)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.258196 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.304986 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4186f53410814f00a151d4c36eafd6c0', 'request_id': 'req-b274fc17-413e-4b44-8061-788a11267136'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:27.311368 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4186f53410814f00a151d4c36eafd6c0', 'request_id': 'req-b274fc17-413e-4b44-8061-788a11267136'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:27.316917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4186f53410814f00a151d4c36eafd6c0', 'request_id': 'req-b274fc17-413e-4b44-8061-788a11267136'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:27.331036 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] The token cache is being invalidate because project 4186f53410814f00a151d4c36eafd6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:27.331321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:27.332010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-b274fc17-413e-4b44-8061-788a11267136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:27.333612 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1416/2827] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:27 2022] DELETE /identity/v3/projects/4186f53410814f00a151d4c36eafd6c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:27.339776 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.340068 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.340404 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.359001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:27.360123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:27.428375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1412/2828] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 03 03:04:27.436670 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.437009 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.437291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.457338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:27.458525 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:27.467799 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1417/2829] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:27.472231 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.483825 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae722-df52-4e98-961f-d4af4f95c998 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.490120 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.490778 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.491052 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.491316 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] PATH_INFO: `/v3/domains` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.492160 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:04:27.492479 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.494164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.506258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1413/2830] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:04:27.510774 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.519951 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fabef6-ce46-47f6-b6b5-f170d21ee3e7 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.525238 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.525905 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.526180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.526449 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.527180 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.529110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.556380 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1418/2831] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:27 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:27.560543 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.570826 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f4ed-0223-4a5b-9f37-427849b3365e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.628180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.628766 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.629074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.629340 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.630043 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.631943 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.653678 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1414/2832] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:27 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:27.658507 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.671235 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0121b-e424-4b69-a8c9-02a03fe68b00 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.676805 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.677462 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.677740 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.678010 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.678745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.680439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.691379 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1419/2833] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:04:27.695804 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.705822 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3846a-132d-443f-965a-5cad889ec8f1 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.711436 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d523c8f-dcc0-40e1-a6be-e9b5a75a1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.712084 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d523c8f-dcc0-40e1-a6be-e9b5a75a1eec admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.712366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d523c8f-dcc0-40e1-a6be-e9b5a75a1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.712628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d523c8f-dcc0-40e1-a6be-e9b5a75a1eec admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.713399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d523c8f-dcc0-40e1-a6be-e9b5a75a1eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.714987 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d523c8f-dcc0-40e1-a6be-e9b5a75a1eec admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.725456 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1415/2834] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:27.730335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.745812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b949aa-3081-4fb3-8c23-e894004c73d6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.752706 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.753932 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.754272 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.754573 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] PATH_INFO: `/v3/projects/11f2c764715748c08e30b543b301cdf0/users/f5dc5ddaf2404a54a25751ceee824e40/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.771035 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f2c764715748c08e30b543b301cdf0, user_id=f5dc5ddaf2404a54a25751ceee824e40, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.773735 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.790737 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1420/2835] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:27 2022] PUT /identity/v3/projects/11f2c764715748c08e30b543b301cdf0/users/f5dc5ddaf2404a54a25751ceee824e40/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:04:27.799133 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.799419 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.799689 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.826217 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] MFA Rules not processed for user `f5dc5ddaf2404a54a25751ceee824e40`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:27.827453 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:27.895063 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1416/2836] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:27.899829 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:27.963124 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87c5f2-261f-4311-bad3-b8ef5b5191a6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:27.968236 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:27.969270 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:27.969553 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:27.969851 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:27.970548 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:27.972458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:27.999650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1421/2837] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:27 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:28.004356 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.016652 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd50d11-c800-49b1-ac2b-e7f5b98f0628 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.077582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.078258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.078537 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.078771 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.079512 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.081493 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.104131 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1417/2838] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:28 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:28.108231 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.118663 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a6c52-9020-4bf8-9d69-968a40303df8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.123697 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.124359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.124644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.124918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.125644 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.127268 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.137743 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1422/2839] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:28.141635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.152557 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bb91-2015-4d4c-a453-c0b042b3ce1c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.159434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2420db3-c2b5-4177-852d-9d9d9c94e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.160094 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2420db3-c2b5-4177-852d-9d9d9c94e30e admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.160382 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2420db3-c2b5-4177-852d-9d9d9c94e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.160649 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2420db3-c2b5-4177-852d-9d9d9c94e30e admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.161450 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2420db3-c2b5-4177-852d-9d9d9c94e30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.163165 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2420db3-c2b5-4177-852d-9d9d9c94e30e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.173439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1418/2840] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 03 03:04:28.177650 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.187588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396825b8-8018-406d-9072-6862dfa39db9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.192170 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.193077 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] REQUEST_METHOD: `PUT` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.193349 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.193614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] PATH_INFO: `/v3/projects/6651c78fb8434f2083083400384fd4be/users/6cd0d5d067c3466b9880741b5d38232e/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.207616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6651c78fb8434f2083083400384fd4be, user_id=6cd0d5d067c3466b9880741b5d38232e, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.210294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.226269 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1423/2841] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:28 2022] PUT /identity/v3/projects/6651c78fb8434f2083083400384fd4be/users/6cd0d5d067c3466b9880741b5d38232e/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:28.238191 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.238530 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.238922 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.267362 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] MFA Rules not processed for user `6cd0d5d067c3466b9880741b5d38232e`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:28.268558 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:28.331434 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1419/2842] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:28.336245 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.397355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02bd77-d2d3-44fe-8b7f-9211ec1e429d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.402458 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.403166 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.403382 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.403645 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] PATH_INFO: `/v3/projects` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.404335 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.406282 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.434247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1424/2843] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:28 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:04:28.438985 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.450941 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176028-1a78-4e85-b70f-8565127a1026 None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.513829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.514492 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.514780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.515044 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] PATH_INFO: `/v3/users` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.515742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.517709 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.539971 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1420/2844] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:28 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:28.544047 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.554186 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7b58-f5d8-448b-87d2-6dd19adf4765 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.558992 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.559647 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.559924 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.560192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.560952 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.562555 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.573982 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1425/2845] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:28.579762 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.590155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f93784-a52e-4fd9-8237-681f77364eca admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.595883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.596745 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.597142 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.597411 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] PATH_INFO: `/v3/projects/08e3a72681cc457f8442487828659daf/users/544399e3083f4dde88b665a616d80a9d/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.612467 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e3a72681cc457f8442487828659daf, user_id=544399e3083f4dde88b665a616d80a9d, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.615153 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.629398 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1421/2846] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:28 2022] PUT /identity/v3/projects/08e3a72681cc457f8442487828659daf/users/544399e3083f4dde88b665a616d80a9d/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:28.633419 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.644595 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61633c9-c62f-4e88-ba2c-4e00a1f410e9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.701287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53235-03bb-40a6-85ba-2852884d2025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.701862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53235-03bb-40a6-85ba-2852884d2025 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.702137 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53235-03bb-40a6-85ba-2852884d2025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.702430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53235-03bb-40a6-85ba-2852884d2025 admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.703128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53235-03bb-40a6-85ba-2852884d2025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.704739 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53235-03bb-40a6-85ba-2852884d2025 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.714415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1426/2847] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:28.719076 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.729918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8075-2edb-41a6-a905-52a9f573f37c admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.736928 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.737803 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.738083 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.738352 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] PATH_INFO: `/v3/projects/08e3a72681cc457f8442487828659daf/users/544399e3083f4dde88b665a616d80a9d/roles/bc3228c6420840ccac55bec33bfa0fb1` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.740312 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e3a72681cc457f8442487828659daf, user_id=544399e3083f4dde88b665a616d80a9d, role_id=bc3228c6420840ccac55bec33bfa0fb1)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:28.743090 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:28.754329 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1422/2848] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:28 2022] PUT /identity/v3/projects/08e3a72681cc457f8442487828659daf/users/544399e3083f4dde88b665a616d80a9d/roles/bc3228c6420840ccac55bec33bfa0fb1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:28.764913 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.765206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.765506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:28.793600 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] MFA Rules not processed for user `544399e3083f4dde88b665a616d80a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:28.794800 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:28.874470 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1427/2849] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:28.884767 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:28.886926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:28.948126 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d465f3-1699-449e-affc-7a721060f5cd admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:28.952816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:28.953427 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:28.953692 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:28.953973 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:29.011647 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:29.013213 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:29.022195 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1423/2850] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:30.524852 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:30.526421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:30.539291 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b22b3-4b28-4a06-a11e-845620fb4af8 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:30.543648 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:30.544287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:30.544537 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:30.544846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:30.600523 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:30.601960 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:30.610733 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1428/2851] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:31.133273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:31.142577 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3d9b-7e18-4f81-95d4-f47c4fe674d1 service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:31.148590 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabec90-add8-4d5b-bcb5-61ad5ee4d7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:31.149259 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabec90-add8-4d5b-bcb5-61ad5ee4d7ec service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:31.149533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabec90-add8-4d5b-bcb5-61ad5ee4d7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:31.149795 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabec90-add8-4d5b-bcb5-61ad5ee4d7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:31.159600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabec90-add8-4d5b-bcb5-61ad5ee4d7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:31.161061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabec90-add8-4d5b-bcb5-61ad5ee4d7ec service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:31.170578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1424/2852] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:35.008668 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:35.073939 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2631b-3929-4293-a34e-aa024d403128 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:35.081243 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:35.082117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:35.082389 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:35.082655 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] PATH_INFO: `/v3/users/f5dc5ddaf2404a54a25751ceee824e40` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:35.083954 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5dc5ddaf2404a54a25751ceee824e40)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:35.085912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:35.136887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5dc5ddaf2404a54a25751ceee824e40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.137540 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5dc5ddaf2404a54a25751ceee824e40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.144098 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5dc5ddaf2404a54a25751ceee824e40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.155427 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5dc5ddaf2404a54a25751ceee824e40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.163206 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5dc5ddaf2404a54a25751ceee824e40'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.169429 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1429/2853] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:35 2022] DELETE /identity/v3/users/f5dc5ddaf2404a54a25751ceee824e40 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:35.174145 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:35.174615 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:35.174712 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:35.192640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:35.193874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:35.262742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1425/2854] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:35.275418 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:35.277136 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:35.335540 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439617e-880d-4454-b4b9-d11ffe68af48 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:35.340071 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:35.340745 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:35.341063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:35.341336 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:35.351360 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:35.352881 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:35.362415 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1430/2855] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:35.626079 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:35.627565 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:35.639813 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a506-186b-4418-8bc3-559577426bbe None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:35.644752 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:35.645628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:35.645930 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:35.646199 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] PATH_INFO: `/v3/projects/11f2c764715748c08e30b543b301cdf0` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:35.647435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f2c764715748c08e30b543b301cdf0)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:35.649391 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:35.696661 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f2c764715748c08e30b543b301cdf0', 'request_id': 'req-9dc33e33-dedb-470b-8e1f-d08beb5e8099'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.704742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f2c764715748c08e30b543b301cdf0', 'request_id': 'req-9dc33e33-dedb-470b-8e1f-d08beb5e8099'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.711334 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f2c764715748c08e30b543b301cdf0', 'request_id': 'req-9dc33e33-dedb-470b-8e1f-d08beb5e8099'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.722249 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] The token cache is being invalidate because project 11f2c764715748c08e30b543b301cdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:35.722533 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.723204 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.724779 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1426/2856] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:35 2022] DELETE /identity/v3/projects/11f2c764715748c08e30b543b301cdf0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:35.728897 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:35.738338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88d0b-0eea-45d5-aa5a-dea05dd7cb53 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:35.805128 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:35.805931 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:35.807306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:35.807306 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] PATH_INFO: `/v3/users/6cd0d5d067c3466b9880741b5d38232e` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:35.807798 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd0d5d067c3466b9880741b5d38232e)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:35.809868 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:35.863551 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd0d5d067c3466b9880741b5d38232e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.864228 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd0d5d067c3466b9880741b5d38232e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.871185 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd0d5d067c3466b9880741b5d38232e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.885320 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd0d5d067c3466b9880741b5d38232e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.896935 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd0d5d067c3466b9880741b5d38232e'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:35.903749 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1431/2857] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:35 2022] DELETE /identity/v3/users/6cd0d5d067c3466b9880741b5d38232e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:36.173472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:36.175124 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:36.189628 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33e33-dedb-470b-8e1f-d08beb5e8099 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:36.256389 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:36.257667 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:36.258028 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:36.258364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] PATH_INFO: `/v3/projects/6651c78fb8434f2083083400384fd4be` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:36.259921 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6651c78fb8434f2083083400384fd4be)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:36.261881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:36.312883 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6651c78fb8434f2083083400384fd4be', 'request_id': 'req-78ed3d49-ccab-49e5-be01-0e80dac27232'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.323506 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6651c78fb8434f2083083400384fd4be', 'request_id': 'req-78ed3d49-ccab-49e5-be01-0e80dac27232'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.329809 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6651c78fb8434f2083083400384fd4be', 'request_id': 'req-78ed3d49-ccab-49e5-be01-0e80dac27232'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.339798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] The token cache is being invalidate because project 6651c78fb8434f2083083400384fd4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:36.340018 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.340663 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.342244 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1427/2858] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:36 2022] DELETE /identity/v3/projects/6651c78fb8434f2083083400384fd4be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:36.346703 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:36.348192 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:36.360907 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca358074-b51f-477e-a45d-2cde8eb6a6f9 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:36.417588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:36.418448 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:36.418692 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:36.419030 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] PATH_INFO: `/v3/users/544399e3083f4dde88b665a616d80a9d` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:36.420287 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544399e3083f4dde88b665a616d80a9d)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:36.422253 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:36.471596 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544399e3083f4dde88b665a616d80a9d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.472294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544399e3083f4dde88b665a616d80a9d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.479651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544399e3083f4dde88b665a616d80a9d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.491286 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544399e3083f4dde88b665a616d80a9d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.498453 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-f773a940-1d49-43c1-9f74-ec0c5a12a0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544399e3083f4dde88b665a616d80a9d'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:36.504148 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1432/2859] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:04:36 2022] DELETE /identity/v3/users/544399e3083f4dde88b665a616d80a9d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:37.050313 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.051773 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:37.066816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3d49-ccab-49e5-be01-0e80dac27232 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.129360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.130221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.130507 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.130777 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] PATH_INFO: `/v3/projects/08e3a72681cc457f8442487828659daf` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.132041 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e3a72681cc457f8442487828659daf)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.134050 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.182566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e3a72681cc457f8442487828659daf', 'request_id': 'req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:37.192366 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e3a72681cc457f8442487828659daf', 'request_id': 'req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:37.198963 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e3a72681cc457f8442487828659daf', 'request_id': 'req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:37.208609 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] The token cache is being invalidate because project 08e3a72681cc457f8442487828659daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:04:37.208874 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:37.209551 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5432ecb8-9ccc-4e43-93ee-06c3901cf7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:04:37.211123 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1428/2860] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:04:37 2022] DELETE /identity/v3/projects/08e3a72681cc457f8442487828659daf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:37.219198 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.219508 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.219782 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.241974 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:37.243280 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:37.309247 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1433/2861] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:37.322435 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.322719 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.322992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.343289 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:37.344918 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:37.357258 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1429/2862] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:37.364297 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.375751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cf594-70f6-49b0-a385-319e24f9f786 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.381934 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.382587 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.382862 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.383129 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.383863 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 03 03:04:37.384152 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.385823 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.397776 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1434/2863] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 3 03:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 03 03:04:37.402286 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.411552 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715dfe-f257-41ad-ad10-5fa15be7731f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.417466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.418106 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.418379 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.418640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] PATH_INFO: `/v3/projects` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.419335 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.421253 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.448136 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1430/2864] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 3 03:04:37 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 03 03:04:37.452421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.462722 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7cbb0-9a46-47c7-9171-8d8229d0b2a8 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.520843 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.521506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.521790 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.522055 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.522758 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.524812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.547796 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1435/2865] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 3 03:04:37 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 03 03:04:37.552349 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.565866 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea0790-4835-47a5-b03f-2cad4dae9024 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.571669 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.572324 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.572600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.572900 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.573635 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.575581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.586960 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1431/2866] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:37.592526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.603801 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513a60-66e7-4d35-b756-f2d46e600ad6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.608887 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489c021-0402-4722-afeb-55a7d81af1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.609531 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c021-0402-4722-afeb-55a7d81af1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.609808 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c021-0402-4722-afeb-55a7d81af1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.610076 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c021-0402-4722-afeb-55a7d81af1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.610806 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489c021-0402-4722-afeb-55a7d81af1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.612392 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489c021-0402-4722-afeb-55a7d81af1ad admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.622609 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1436/2867] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 3 03:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 03 03:04:37.626820 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.636962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044d66-adc4-4bb8-8816-babbe16c6217 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.642081 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.643001 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.643274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.643549 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] PATH_INFO: `/v3/projects/b3c17e83a1e6491b9caecd968321a263/users/04c8680f685446b2b96aaea84587b7bd/roles/4e7921a08ea049ac85d7f219cc8c8fc7` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.658787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c17e83a1e6491b9caecd968321a263, user_id=04c8680f685446b2b96aaea84587b7bd, role_id=4e7921a08ea049ac85d7f219cc8c8fc7)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.661471 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.675835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1432/2868] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 3 03:04:37 2022] PUT /identity/v3/projects/b3c17e83a1e6491b9caecd968321a263/users/04c8680f685446b2b96aaea84587b7bd/roles/4e7921a08ea049ac85d7f219cc8c8fc7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:04:37.681146 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff552c2-0536-46d0-a8cd-858cb56a2db9 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.681430 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff552c2-0536-46d0-a8cd-858cb56a2db9 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.681751 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff552c2-0536-46d0-a8cd-858cb56a2db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.700108 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3ff552c2-0536-46d0-a8cd-858cb56a2db9 None None] MFA Rules not processed for user `fbd82c2696a04c4883c8116f54cc6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:37.701359 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3ff552c2-0536-46d0-a8cd-858cb56a2db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:37.761319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1437/2869] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:37.781375 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:37.784425 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:37.849173 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7c0a7-12e0-4788-bde7-35cdd183bd28 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:37.854180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:37.854830 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:37.855070 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:37.855364 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:37.865965 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:37.867451 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:37.876853 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1433/2870] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:38.461569 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7ae3b-c5b4-4d48-b0b9-8525b31bf4eb None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:38.462190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7ae3b-c5b4-4d48-b0b9-8525b31bf4eb None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:38.462190 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7ae3b-c5b4-4d48-b0b9-8525b31bf4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:38.492768 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-50a7ae3b-c5b4-4d48-b0b9-8525b31bf4eb None None] MFA Rules not processed for user `04c8680f685446b2b96aaea84587b7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:38.493990 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-50a7ae3b-c5b4-4d48-b0b9-8525b31bf4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:38.566279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1438/2871] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:38.576155 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:38.577620 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:38.639717 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0d952-d35d-4670-b696-e825c126c289 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:38.643850 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:38.644858 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:38.645268 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:38.645538 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:38.654924 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:38.656581 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:38.666036 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1434/2872] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:40.038912 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273e2c1-91d2-40a6-868d-6ebece73623d None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:40.039434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273e2c1-91d2-40a6-868d-6ebece73623d None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:40.039434 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273e2c1-91d2-40a6-868d-6ebece73623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:40.057919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-b273e2c1-91d2-40a6-868d-6ebece73623d None None] MFA Rules not processed for user `04c8680f685446b2b96aaea84587b7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:40.059110 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-b273e2c1-91d2-40a6-868d-6ebece73623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:40.066511 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1439/2873] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:04:49.175285 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:04:49.176864 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:49.249578 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b75909-1610-4528-9224-b2769cf6142f service cinder] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:04:49.254489 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:04:49.255179 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:49.255454 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:49.255725 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:49.257612 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:49.270260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:04:49.271908 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb09dd-7bff-43bb-8048-9856bc9d2ccb service placement] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:04:49.284742 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1435/2874] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:04:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:04:49.923200 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c01bf-645b-4a54-afd9-7d2810081319 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:04:49.923702 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c01bf-645b-4a54-afd9-7d2810081319 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:04:49.923802 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c01bf-645b-4a54-afd9-7d2810081319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:04:49.941277 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-3a8c01bf-645b-4a54-afd9-7d2810081319 None None] MFA Rules not processed for user `6a97115409ba4be989f9071c61df79a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:04:49.942459 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3a8c01bf-645b-4a54-afd9-7d2810081319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:04:50.000909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1440/2875] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:04:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:05:42.170215 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:05:42.170769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:05:42.170769 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:05:42.189035 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] MFA Rules not processed for user `04c8680f685446b2b96aaea84587b7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:05:42.190252 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:05:42.198394 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1436/2876] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:06:13.702037 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] REQUEST_METHOD: `POST` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:13.702626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:13.702626 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:13.724872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.auth.core [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] MFA Rules not processed for user `26f6ffc1c2bf44aa85d5529cfd469146`. Rule list: `[]` (Enabled: `True`). {{(pid=79164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:06:13.726063 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:13.781358 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1441/2877] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 3 03:06:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:06:13.823754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:13.825502 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:13.903926 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c607ea-bf98-4797-b6b9-f97758d2304d None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:13.909283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8951b6805c1d4f619c6fc26249eda16f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:13.910209 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:13.910336 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:13.910545 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:13.919755 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:13.921478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:13.929758 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1437/2878] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 3 03:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 03 03:06:20.546725 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:20.548244 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:20.566998 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67940f4e-a277-4b5a-b2ab-a3eac2ab2838 None None] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:20.571769 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:20.572649 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:20.572972 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:20.573260 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] PATH_INFO: `/v3/users/c4ba512a106549b2b072c40fd33bebcb` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:20.575374 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ba512a106549b2b072c40fd33bebcb)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:20.577288 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:20.627584 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ba512a106549b2b072c40fd33bebcb'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.628222 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ba512a106549b2b072c40fd33bebcb'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.634742 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ba512a106549b2b072c40fd33bebcb'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.647002 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ba512a106549b2b072c40fd33bebcb'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.656174 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ba512a106549b2b072c40fd33bebcb'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.664967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1442/2879] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:06:20 2022] DELETE /identity/v3/users/c4ba512a106549b2b072c40fd33bebcb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:06:20.842653 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:20.855360 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e054-9d24-4aad-ae07-21c3ab1d6a52 service swift] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:20.912295 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:20.913207 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:20.913481 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:20.913787 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] PATH_INFO: `/v3/projects/75a68a1b96ee4033bf683db87d2c6cfc` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:20.915861 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a68a1b96ee4033bf683db87d2c6cfc)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:20.917829 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:20.967923 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a68a1b96ee4033bf683db87d2c6cfc', 'request_id': 'req-3cc9178b-cb7e-42d2-b539-117fa59663a5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.981297 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a68a1b96ee4033bf683db87d2c6cfc', 'request_id': 'req-3cc9178b-cb7e-42d2-b539-117fa59663a5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.987970 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a68a1b96ee4033bf683db87d2c6cfc', 'request_id': 'req-3cc9178b-cb7e-42d2-b539-117fa59663a5'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.998184 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] The token cache is being invalidate because project 75a68a1b96ee4033bf683db87d2c6cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:06:20.998466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:20.999087 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.000909 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1438/2880] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:06:20 2022] DELETE /identity/v3/projects/75a68a1b96ee4033bf683db87d2c6cfc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:06:21.004845 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:21.006321 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:21.019601 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac8caf-3fac-4da4-928c-cdba001e03df admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:21.074117 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:21.074918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:21.075211 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:21.075440 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] PATH_INFO: `/v3/users/b58f7dd4d7654b7489130a2f80070bc4` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:21.076893 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58f7dd4d7654b7489130a2f80070bc4)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:21.078841 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:21.127526 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58f7dd4d7654b7489130a2f80070bc4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.128212 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58f7dd4d7654b7489130a2f80070bc4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.135104 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58f7dd4d7654b7489130a2f80070bc4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.147659 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58f7dd4d7654b7489130a2f80070bc4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.157455 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58f7dd4d7654b7489130a2f80070bc4'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.163506 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1443/2881] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:06:21 2022] DELETE /identity/v3/users/b58f7dd4d7654b7489130a2f80070bc4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 03 03:06:21.334439 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:21.335939 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:21.349568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9178b-cb7e-42d2-b539-117fa59663a5 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:21.404440 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:21.405330 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:21.405662 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:21.405819 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] PATH_INFO: `/v3/projects/754093811911452e9c216cb971b60309` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:21.407074 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=754093811911452e9c216cb971b60309)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:21.408993 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:21.454053 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754093811911452e9c216cb971b60309', 'request_id': 'req-5d3d4370-7f6c-4202-b819-d0268ee6f33e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.462655 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754093811911452e9c216cb971b60309', 'request_id': 'req-5d3d4370-7f6c-4202-b819-d0268ee6f33e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.469047 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754093811911452e9c216cb971b60309', 'request_id': 'req-5d3d4370-7f6c-4202-b819-d0268ee6f33e'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.480582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] The token cache is being invalidate because project 754093811911452e9c216cb971b60309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:06:21.481006 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.481882 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:21.484222 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1439/2882] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:06:21 2022] DELETE /identity/v3/projects/754093811911452e9c216cb971b60309 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:06:35.256847 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:35.258314 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:35.271978 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e1a3e-670a-4e08-9a90-bd5745a32a7d admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:35.334295 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:35.335080 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:35.335355 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:35.335622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] PATH_INFO: `/v3/users/04c8680f685446b2b96aaea84587b7bd` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:35.336983 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c8680f685446b2b96aaea84587b7bd)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:35.338918 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:35.387414 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c8680f685446b2b96aaea84587b7bd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.388107 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c8680f685446b2b96aaea84587b7bd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.394855 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c8680f685446b2b96aaea84587b7bd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.406473 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c8680f685446b2b96aaea84587b7bd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.415558 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c8680f685446b2b96aaea84587b7bd'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.421988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1444/2883] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:06:35 2022] DELETE /identity/v3/users/04c8680f685446b2b96aaea84587b7bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:06:35.596273 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:35.597798 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:35.610566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d4370-7f6c-4202-b819-d0268ee6f33e admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:35.667233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:35.668101 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:35.668371 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:35.668640 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] PATH_INFO: `/v3/projects/b3c17e83a1e6491b9caecd968321a263` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:35.669982 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c17e83a1e6491b9caecd968321a263)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:35.671919 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:35.719468 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c17e83a1e6491b9caecd968321a263', 'request_id': 'req-496363a0-94b3-4a08-8c4d-4b4683e6b02d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.728828 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c17e83a1e6491b9caecd968321a263', 'request_id': 'req-496363a0-94b3-4a08-8c4d-4b4683e6b02d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.735600 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c17e83a1e6491b9caecd968321a263', 'request_id': 'req-496363a0-94b3-4a08-8c4d-4b4683e6b02d'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.745881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] The token cache is being invalidate because project b3c17e83a1e6491b9caecd968321a263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:06:35.746247 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.746881 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-496363a0-94b3-4a08-8c4d-4b4683e6b02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:06:35.748521 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1440/2884] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:06:35 2022] DELETE /identity/v3/projects/b3c17e83a1e6491b9caecd968321a263 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:06:50.466885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:50.468732 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:50.532089 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d132-cf01-4af1-88dd-0f862378d162 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:50.580681 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:50.581361 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:50.581664 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:50.581917 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:50.583741 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:50.593965 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:50.595486 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:50.603896 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1445/2885] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:06:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:06:52.114196 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] REQUEST_METHOD: `POST` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:52.114816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:52.114816 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:52.141584 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.auth.core [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] MFA Rules not processed for user `6a97115409ba4be989f9071c61df79a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 03 03:06:52.142759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:52.199121 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1441/2886] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 3 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 03 03:06:52.233512 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:52.235072 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:52.298621 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490adf3-94fb-4af5-8270-35a4e0291c19 service neutron] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:52.303510 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30865d753bcb4542bee3b1c86a14b51e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:52.304154 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:52.304439 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:52.304728 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:52.306675 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:52.400622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:52.402131 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:52.413580 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1446/2887] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:06:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:06:52.714260 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:52.716144 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:52.729274 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646878a0-2a9f-4fab-b0c1-ea1c4b9b081f None None] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:52.733992 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:52.734624 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:52.734899 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:52.735164 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:52.737491 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:52.747996 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:52.749473 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:52.757780 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1442/2888] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:06:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:06:53.205696 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:53.207451 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:53.215221 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:06:53.224365 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce04b1b-a097-4b42-9fa2-975f2029c501 service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:53.229185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:53.229835 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:53.230104 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:53.230370 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:53.232388 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:53.246051 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:53.247486 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:53.258648 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1443/2889] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:06:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:06:53.277033 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d7541-f8c1-404b-a18c-a97e41d66965 service cinder] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:06:53.282390 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:06:53.283038 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:06:53.283319 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:06:53.283588 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:06:53.285556 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:06:53.297273 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:06:53.298872 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:06:53.308812 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1447/2890] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:06:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:07:07.695833 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:07:07.698447 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:07:07.718091 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9620b76-84fb-4f0f-843d-515c4221f19b service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:07:07.725149 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:07:07.725784 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:07:07.726061 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:07:07.726325 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:07:07.728308 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:07:07.738564 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:07:07.740152 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:07:07.749759 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1444/2891] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:07:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:07:10.935792 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:07:10.937338 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:07:10.952657 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a063b-487f-492a-99a3-9a1d836791e9 service placement] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:07:10.958535 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e2802cd72344deb281b227f9acb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:07:10.959173 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:07:10.959450 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:07:10.959716 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:07:10.961614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:07:10.974140 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:07:10.975721 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:07:10.986176 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1448/2892] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:07:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 03 03:09:03.374606 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:09:03.384478 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e81b-0bec-4e41-ba6b-b5be00f45642 service nova] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:09:03.388180 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482bb28bcb834632a7354ac78f762ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:09:03.388855 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] REQUEST_METHOD: `GET` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:09:03.389129 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:09:03.389399 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:09:03.391137 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:09:03.455113 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:09:03.456544 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:09:03.466472 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1445/2893] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 03 03:09:09.986794 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:09:09.988263 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:09:10.007651 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef874996-7951-4f74-a89b-9b6b47ab690f service nova] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:09:10.012446 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:09:10.013347 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:09:10.013622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:09:10.013885 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] PATH_INFO: `/v3/users/6a97115409ba4be989f9071c61df79a5` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:09:10.015090 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a97115409ba4be989f9071c61df79a5)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:09:10.017135 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:09:10.072704 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a97115409ba4be989f9071c61df79a5'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.073421 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a97115409ba4be989f9071c61df79a5'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.080505 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a97115409ba4be989f9071c61df79a5'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.093967 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a97115409ba4be989f9071c61df79a5'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.102962 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a97115409ba4be989f9071c61df79a5'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.109145 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1449/2894] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:09:09 2022] DELETE /identity/v3/users/6a97115409ba4be989f9071c61df79a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:09:10.281814 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:09:10.292460 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba0cc-3876-4baa-a6b8-48b3ea225f6a service neutron] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:09:10.347582 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:09:10.348449 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:09:10.348754 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:09:10.349027 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] PATH_INFO: `/v3/projects/264ee2f5b580483c85a302041b05c23f` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:09:10.350201 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264ee2f5b580483c85a302041b05c23f)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:09:10.352283 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:09:10.397185 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264ee2f5b580483c85a302041b05c23f', 'request_id': 'req-0555cf65-b707-4734-9224-bef5a9b68b44'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.405218 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264ee2f5b580483c85a302041b05c23f', 'request_id': 'req-0555cf65-b707-4734-9224-bef5a9b68b44'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.411310 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264ee2f5b580483c85a302041b05c23f', 'request_id': 'req-0555cf65-b707-4734-9224-bef5a9b68b44'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.421944 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] The token cache is being invalidate because project 264ee2f5b580483c85a302041b05c23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:09:10.422233 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.422962 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.424623 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1446/2895] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:09:10 2022] DELETE /identity/v3/projects/264ee2f5b580483c85a302041b05c23f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:09:10.428870 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:09:10.430404 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:09:10.443602 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c696-c813-423b-9d78-80b6e52e37b6 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:09:10.501197 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:09:10.502066 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:09:10.502348 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:09:10.502623 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] PATH_INFO: `/v3/users/605e0f19733848028965fe69e1692f28` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:09:10.503942 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605e0f19733848028965fe69e1692f28)` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:09:10.505919 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:09:10.554064 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605e0f19733848028965fe69e1692f28'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.554713 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605e0f19733848028965fe69e1692f28'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.561909 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605e0f19733848028965fe69e1692f28'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.574294 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605e0f19733848028965fe69e1692f28'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.583616 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.notifications [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605e0f19733848028965fe69e1692f28'} {{(pid=79164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.590846 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1450/2896] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 3 03:09:10 2022] DELETE /identity/v3/users/605e0f19733848028965fe69e1692f28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:09:10.764889 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Authenticating user token {{(pid=79163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:09:10.766566 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.fernet_utils [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:09:10.780197 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555cf65-b707-4734-9224-bef5a9b68b44 admin admin] Validating token access rules against request {{(pid=79163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:09:10.837466 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd82c2696a04c4883c8116f54cc6d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8bb283e83f49d4ae1d0a1e9323f94b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:09:10.838339 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:09:10.838616 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:09:10.838884 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] PATH_INFO: `/v3/projects/92cf629d2e5e4953b30af7efc8d007f6` {{(pid=79163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:09:10.840239 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cf629d2e5e4953b30af7efc8d007f6)` {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:09:10.842568 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] RBAC: Authorization granted {{(pid=79163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:09:10.890879 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cf629d2e5e4953b30af7efc8d007f6', 'request_id': 'req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.898912 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cf629d2e5e4953b30af7efc8d007f6', 'request_id': 'req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.905498 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cf629d2e5e4953b30af7efc8d007f6', 'request_id': 'req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a'} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.916002 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] The token cache is being invalidate because project 92cf629d2e5e4953b30af7efc8d007f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 03 03:09:10.916317 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.917023 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: DEBUG keystone.notifications [None req-d285c297-3dc3-4f58-9a2e-1c8bc1774b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 03 03:09:10.918569 dv-cinder-827581-1-iscsi devstack@keystone.service[79163]: [pid: 79163|app: 0|req: 1447/2897] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 3 03:09:10 2022] DELETE /identity/v3/projects/92cf629d2e5e4953b30af7efc8d007f6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 03 03:09:52.738614 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Authenticating user token {{(pid=79164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 03 03:09:52.740480 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:09:53.028491 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d399f7-db34-44b7-a1c1-bfa084674605 admin admin] Validating token access rules against request {{(pid=79164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 03 03:09:53.093279 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd598cc17e70b46058bd824c031a0186c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9c65257f44407bad0733973d36ce69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 03 03:09:53.094252 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] REQUEST_METHOD: `GET` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 03 03:09:53.094622 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] SCRIPT_NAME: `/identity` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 03 03:09:53.094988 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 03 03:09:53.097767 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.fernet_utils [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 03 03:09:53.111354 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 03 03:09:53.112980 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df5cb5-bd9a-4d82-86b5-ede5f2bfbe4b service placement] RBAC: Authorization granted {{(pid=79164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 03 03:09:53.122502 dv-cinder-827581-1-iscsi devstack@keystone.service[79164]: [pid: 79164|app: 0|req: 1451/2898] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 3 03:09:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)